Image detecting apparatus, image detecting method, and image detecting program

ABSTRACT

An image detecting apparatus has an edit function with good operability and compatibility. When a chapter mark key on a remote control is pressed while an image reproducing system including an MPEG video decoder, a video signal post-processing circuit, a combining circuit, and an NTSC encoder is reproducing image data recorded on a recording medium, a CPU obtains information for identifying the image being reproduced and displayed, and then records the information on the recording medium. With reference to the image provided with a chapter mark, a still image generating circuit displays reduced still images, for example, so that a target image can be specified. Reproduction and editing can be performed with reference to the specified image.

BACKGROUND OF THE INVENTION

The present invention relates to an image detecting apparatus includedin a digital recorder, for example, for detecting a target image fromimage information recorded on a recording medium, an image detectingmethod and an image detecting program applied to the image detectingapparatus.

Some existing digital recorders for home use include an edit function.When a digital recorder for home use including an edit function performsan editing operation, such as deleting an unnecessary scene orextracting only a necessary scene from a recorded television program,for example, the editing operation is performed by changing the digitalrecorder to an edit mode.

Specifically, a user of the digital recorder for home use first changesthe digital recorder to the edit mode, and then reproduces the recordedtelevision program to be edited. While checking the reproduced image,the user searches for an edit point of a target scene by operating a“reproducing key,” a “fast forward key,” a “fast reverse key,” a “stopkey,” a “pause key,” and the like provided on a remote control of thedigital recorder .

Then, a desired editing operation is performed by operating editingoperation keys such as a “chapter division key,” a “start pointspecifying key,” an “end point specifying key,” a “deleting key,” an“extracting key,” and the like provided on the same remote control.Incidentally, when the user is to specify an edit point as accurately aspossible, the user searches for a frame image considered mostappropriate as the edit point by making full use of a “slow reproductionkey” and a “frame advance key.”

Incidentally, by enabling operation of the editing operation keys usedonly at a time of editing, such as the “chapter division key,” the“start point specifying key,” the “end point specifying key,” the“deleting key,” the “extracting key,” and the like, after changing tothe edit mode, erroneous operation of these editing operation keys canbe prevented.

In editing recorded data as described above by the conventional digitalrecorder for home use having an edit function as described above, sincethe remote control receiving instruction inputs from the user isprovided with many operating keys, the user may have to check thepositions of the operating keys on the remote control at handfrequently.

Therefore, the user may miss a scene in which a target edit point ispresent while checking the positions of the operating keys on the remotecontrol, or the user may erroneously operate the remote control whilechecking the reproduced image.

In addition, when searching for an edit point, the user cannot specifyan image in a specifiable unit, for example, a frame unit. Therefore, atarget edit point cannot be specified accurately and easily, so thattrouble and time may be required before specifying the target editpoint.

Furthermore, while editing operations on the recorded data are enabledafter changing to the edit mode, as described above, some users may notknow the operation for changing to the edit mode and thus take timebefore editing the recorded data.

Further, with the increase in capacity of recording media, the recordingtime during which moving images recordable on recording media arerecorded is also increased. When setting an edit point in a programrecorded for a long time, for example, it takes a considerable time tofind the edit point by reproducing the program from the start. Even ifthe program is reproduced from the middle, a skipped portion may includea desired edit point, so that the appropriate edit point may not bedetected. Thus, there is a desire for a means to enable a target sceneto be detected quickly and accurately from image information having along reproduction time reaching several hours.

In view of the above, it is an object of the present invention toeliminate the above problems, realize an image detecting apparatus withgood operability and compatibility that makes it possible to quickly andaccurately detect target image information from recorded imageinformation, and provide an image detecting method and an imagedetecting program for use in the image detecting apparatus.

SUMMARY OF THE INVENTION

In order to solve the above problems, there is provided an imagedetecting apparatus as set forth in claim 1, the image detectingapparatus including: extracting means for extracting one or more frameimages from a plurality of frame images forming a moving image; displaycontrolling means for controlling display of the frame image extractedand a predetermined number of frame images temporally preceding andsucceeding the frame image; and specifying means for selecting andspecifying a desired frame image from the plurality of frame imageswhose display is controlled by the display controlling means.

With the image detecting apparatus as set forth in claim 1, theextracting means extracts a frame image specified by a user, forexample, from a plurality of frame images forming a moving image, andthe display controlling means controls display such that the extractedframe image and a predetermined number of frame images preceding andsucceeding the frame image are displayed simultaneously.

The specifying means then specifies a target frame image from theplurality of frame images displayed by the display controlling means.Thus, edit points such as a start point and an end point of a targetscene and the like can be detected quickly, accurately, and easily fromthe plurality of frame images forming the moving image.

Further, there is provided an image detecting apparatus according to aninvention as set forth in claim 5, the image detecting apparatusincluding: first extracting means for extracting a predetermined numberof frame images from a plurality of frame images forming a moving image;first display controlling means for controlling display of apredetermined number of moving images with the predetermined number offrame images extracted by the first extracting means as initial images;first specifying means for selecting and specifying a desired movingimage from the predetermined number of moving images whose display iscontrolled by the first display controlling means; second extractingmeans for extracting an arbitrary frame image from the moving imagespecified by the first specifying means; second display controllingmeans for controlling display of the frame image extracted by the secondextracting means and a predetermined number of frame images temporallypreceding and succeeding the frame image; and second specifying meansfor selecting and specifying a desired frame image from the frame imageswhose display is controlled by the second display controlling means.

With the image detecting apparatus as set forth in claim 5, the firstextracting means extracts frame images specified by a user, for example,from a plurality of frame images forming a moving image, and the firstdisplay controlling means controls display such that a predeterminednumber of moving images are displayed simultaneously with the extractedframe images as initial images.

The first specifying means then specifies a desired moving image fromthe plurality of moving images displayed by the first displaycontrolling means. The second extracting means thereafter extracts anarbitrary frame image from the specified moving image.

The second display controlling means displays the frame image extractedby the second extracting means and frame images preceding and succeedingthe frame image. Of the displayed images, a desired frame image can bespecified via the second specifying means.

Thus, edit points such as a start point and an end point of a targetscene and the like can be detected quickly, accurately, and easily fromthe plurality of frame images forming the moving image.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of assistance in explaining an image processingsystem formed by using a recording and reproducing apparatus to which animage detecting apparatus according to the present invention is applied;

FIG. 2 is a block diagram of assistance in explaining the configurationof the recording and reproducing apparatus to which the image detectingapparatus according to the present invention is applied;

FIG. 3 is a diagram of assistance in explaining an example of an imagedisplayed on a display screen 201 immediately after an operation ofputting a chapter mark;

FIG. 4 is a diagram of assistance in explaining an example of imagedisplay when reduced still images (thumbnails) are displayed;

FIGS. 5A to 5C are diagrams of assistance in explaining the selection ofa reduced still image, scroll display, and the display of a menu for areduced still image;

FIG. 6 is a diagram of assistance in explaining the use of a time lineand triangular marks;

FIG. 7 is a diagram of assistance in explaining an example of itemsdisplayed on the display screen;

FIG. 8 is a flowchart of assistance in explaining the operation duringreproduction;

FIG. 9 is a flowchart continued from FIG. 8;

FIG. 10 is a flowchart continued from FIG. 9;

FIG. 11 is a diagram of assistance in explaining another example of adisplayed image;

FIG. 12 is a diagram of assistance in explaining another example of adisplayed image;

FIG. 13 is a diagram of assistance in explaining a second embodiment ofthe recording and reproducing apparatus to which the image detectingapparatus according to the present invention is applied;

FIG. 14 is a diagram of assistance in explaining an example of adisplayed image formed by the recording and reproducing apparatus shownin FIG. 13;

FIG. 15 is a diagram of assistance in explaining another example of adisplayed image formed by the recording and reproducing apparatus shownin FIG. 13;

FIG. 16 is a diagram of assistance in explaining another example of adisplayed image formed by the recording and reproducing apparatus shownin FIG. 13;

FIG. 17 is a diagram of assistance in explaining the operation of a userand the recording and reproducing apparatus 600 when an image to be usedas an edit candidate point is selected from among images of a targetscene;

FIG. 18 is a diagram of assistance in explaining the operation of theuser and the recording and reproducing apparatus 600 when an image to beused as an edit candidate point is selected from among images of atarget scene;

FIG. 19 is a flowchart of assistance in explaining the operation of therecording and reproducing apparatus according to the second embodimentshown in FIG. 13;

FIG. 20 is a flowchart continued from FIG. 19;

FIG. 21 is a diagram of assistance in explaining the processing when asucceeding reproducing point catches up with an edit candidate point setahead of the succeeding reproducing point in the recording andreproducing apparatus in a second example of the second embodiment;

FIG. 22 is a diagram of assistance in explaining a case in which acursor CS is not positioned at a sub-image display area SG2;

FIG. 23 is a diagram of assistance in explaining the operation of therecording and reproducing apparatus after an edit point is set withreference to the reproducing point that has caught up with the editcandidate point;

FIG. 24 is a diagram of assistance in explaining an example where thereproduction speed is changed according to the position of thereproducing point;

FIG. 25 is a diagram of assistance in explaining an example where thereproduction speed is changed according to the position of thereproducing point;

FIG. 26 is a diagram of assistance in explaining an example where thereproduction speed is changed according to the position of thereproducing point;

FIG. 27A and FIG. 27B are diagrams of assistance in explaining a case ofa reproducing point ahead being overtaken by a succeeding reproducingpoint, and the like;

FIG. 28A and FIG. 28B are diagrams of assistance in explaining a case ofa reproducing point ahead being overtaken by a succeeding reproducingpoint, and the like;

FIG. 29A to 29C are diagrams of assistance in explaining a case of areproducing point ahead being overtaken by a succeeding reproducingpoint, and the like;

FIG. 30 is a diagram of assistance in explaining the automatic settingof reproducing points when the user sets the reproduction speed;

FIGS. 31A to 31C are diagrams of assistance in explaining the automaticsetting of reproducing points when the user sets the reproduction speed;

FIG. 32 is a diagram of assistance in explaining the automatic settingof reproducing points when the user sets the reproduction speed;

FIG. 33 is a diagram of assistance in explaining an image in which editcandidate point information is displayed by using past edit pointinformation; and

FIG. 34 is a diagram of assistance in explaining an image in which theedit candidate point information is displayed by using the past editpoint information.

DETAILED DESCRIPTION

An embodiment of an image detecting apparatus, an image detectingmethod, and an image detecting program according to the presentinvention will hereinafter be described. The description below of theembodiment will be made by taking as an example a case where the presentinvention is applied to a recording and reproducing apparatus using ahard disk as a recording medium.

[First Embodiment]

[Example of Mode of Using Recording and Reproducing Apparatus]

FIG. 1 is a diagram of assistance in explaining a recording andreproducing apparatus 100 to which an image detecting apparatus, animage detecting method, and an image detecting program according to thepresent invention are applied. The recording and reproducing apparatus100 is connected to a monitor receiver 200 to which a reproduced imagesignal formed in the recording and reproducing apparatus 100 issupplied, as well as various digital devices and analog devices forsupplying information, including image information, whereby an imageprocessing system can be constructed.

FIG. 1 is a diagram of assistance in explaining the image processingsystem constructed using the recording and reproducing apparatus 100according to the present embodiment. As shown in FIG. 1, the recordingand reproducing apparatus 100 is connected to a BS/CS tuner 300 as adigital device, a terrestrial television tuner 400 as an analog device,and a video camera 500 as a digital device.

It is to be noted that devices connectable to the recording andreproducing apparatus 100 are not limited to those shown in FIG. 1. Forexample, various reproducing devices and recording and reproducingdevices, such as DVD (Digital Versatile Disk) players, VTRs (Video TapeRecorders), recording and reproducing devices using a hard disk as arecording medium, and the like, are connectable to the recording andreproducing apparatus 100.

The recording and reproducing apparatus 100 in the present embodimentcan be supplied with a digital signal or an analog signal includingimage information, such as a broadcast signal from the BS/CS tuner 300or the terrestrial television tuner 400, recorded information from thevideo camera 500, or the like, and can record the signal as a digitalsignal onto a recording medium (hard disk) included in the recording andreproducing apparatus 100.

Also, the recording and reproducing apparatus 100 can read imageinformation recorded on the recording medium of the recording andreproducing apparatus 100, reproduce an image signal for displaying animage on a display screen of the monitor receiver 200 as a displayelement, and supply the image signal to the monitor receiver 200.Thereby, the image corresponding to the image information recorded onthe hard disk of the recording and reproducing apparatus 100 can bedisplayed on the display screen of the monitor receiver 200 to be viewedby a user.

The case of recording and reproducing image information has been mainlydescribed above. However, both a broadcast signal for providing atelevision broadcast program and recorded information from the videocamera include sound information as well as image information. Inaddition to image information, the recording and reproducing apparatus100 can record sound information supplied together with the imageinformation onto the recording medium, and reproduce the recordedinformation. Incidentally, though not shown, the reproduced soundinformation is supplied to a speaker or the like provided to the monitorreceiver, for example.

Further, various instructions can be given to the recording andreproducing apparatus 100 by operating an operating key group of anoperating panel 45 provided on the front panel of the main body of therecording and reproducing apparatus 100, or by operating an operatingkey group of a remote control commander (remote control) 150 for therecording and reproducing apparatus 100.

Incidentally, an infrared remote control signal corresponding to anoperation of the operating key group of the remote control 150 is outputfrom a remote control signal output unit 151 of the remote control 150.The infrared remote control signal is received by a remote controlsignal receiving unit 44 provided on the front panel of the main body ofthe recording and reproducing apparatus 100. Thereby, informationcorresponding to the operation of the operating key group of the remotecontrol 150 is notified to the recording and reproducing apparatus 100.

Specifically, ordinary operating instructions to start and stoprecording, start and stop reproduction, start and stop fast forward,start and stop fast reverse, pause and cancel the pause, and editinstructions to put a mark referred to as a chapter mark around a targetscene of image information being reproduced and delete or move an imagesection provided with chapter marks, for example, as will be describedlater in detail, can be input to the recording and reproducing apparatus100 through the operating key group of the operating panel 45 providedon the front panel of the recording and reproducing apparatus 100 orthrough the operating key group of the remote control 150.[Configuration of Recording and Reproducing Apparatus]

FIG. 2 is a block diagram of assistance in explaining the configurationof the recording and reproducing apparatus 100 according to the presentembodiment. A CPU (Central Processing Unit) 40 in FIG. 2 controls allcircuit blocks that will be described later. The CPU 40 accesses a ROM(Read Only Memory) 41, a RAM (Random Access Memory) 42, and an EEPROM(Electrically Erasable and Programmable ROM) 43 via a host bus asrequired, and controls the whole of the recording and reproducingapparatus (image detecting apparatus) 100.

As shown in FIG. 2, the host bus is connected to the light receivingunit 44 for receiving an infrared remote control signal. The lightreceiving unit 44 can receive an infrared remote control signal from theremote control 150, convert the infrared remote control signal into anelectric signal, and then supply the electric signal to the CPU 40.

The CPU 40 can thereby control various parts to perform processingcorresponding to an instruction supplied from a user via the remotecontrol 150, and make various settings in the EEPROM 43, for example.

Various programs to be executed by the recording and reproducingapparatus 100 according to the present embodiment and various datanecessary for processing are recorded in the ROM 41. The RAM 42 ismainly used as a work area for temporarily recording results ofprocessing in progress and the like. The EEPROM 43 is a so-callednonvolatile memory for storing and retaining data that needs to beretained even after power is shut down, for example various setting dataand the like.

The recording and reproducing apparatus 100 according to the presentembodiment shown in FIG. 2 has a digital input terminal 1, a digitalinput/output terminal 2, an analog audio input terminal 4, and analogvideo input terminals 8 and 10 as an input terminal part. The analogvideo input terminal 8 is for a composite image signal (Cps). The analogvideo input terminal 10 is for a separate image signal (S).

The recording and reproducing apparatus 100 has the digital input/outputterminal 2, an analog audio output terminal 22, and analog video outputterminals 28 and 29 as an output terminal part. The analog video outputterminal 28 is for a composite image signal (Cps). The analog videooutput terminal 29 is for a separate image signal (S).

The recording and reproducing apparatus 100 according to the presentembodiment further includes a communication connection terminal 31 tosend and receive various data through a communication network, such as,for example, the Internet, via a communication interface (hereinafterabbreviated as a communication I/F) 30.

The recording and reproducing apparatus 100 can record a video signaland an audio signal received via the above-mentioned input terminals andinput/output terminal onto a recording medium 18 as a hard disk, andoutput the video signal and the audio signal via the above-mentionedoutput terminals and input/output terminal. Also, the recording andreproducing apparatus 100 can read and reproduce the video signal andthe audio signal recorded on the recording medium 18, and output thevideo signal and the audio signal via each output terminal.

Further, the recording and reproducing apparatus 100 can record datareceived via the above-mentioned communication connection terminal 31onto the recording medium 18, digitally output the data, and, when thereceived data is video data and audio data, convert these pieces of datainto analog signals and then output the analog signals via the analogoutput terminals.

As shown in FIG. 1, the recording and reproducing apparatus 100 in thepresent embodiment is connected to the BS/CS tuner 300, the terrestrialtelevision tuner 400, and the video camera 500. In this case, thedescription below will proceed supposing that the BS/CS tuner 300 isconnected to the recording and reproducing apparatus 100 via the digitalinput terminal 1, the terrestrial television tuner 400 is connected tothe recording and reproducing apparatus 100 via the analog audio inputterminal 4 and the analog video input terminal 8 or the analog videoinput terminal 10, and the video camera 500 is connected to therecording and reproducing apparatus 100 via the digital input/outputterminal 2.

[Use of Digital Input]

A description will now be made of the operation of the recording andreproducing apparatus 100 according to the present embodiment when therecording and reproducing apparatus 100 is supplied with information viathe above-mentioned input terminals. A description will first be made ofthe operation of the recording and reproducing apparatus 100 when therecording and reproducing apparatus 100 is supplied with a BS digitalbroadcast signal or a CS digital broadcast signal from the BS/CS tuner300 connected via the digital input terminal 1, records the BS digitalbroadcast signal or the CS digital broadcast signal onto the recordingmedium 18, and outputs the BS digital broadcast signal or the CS digitalbroadcast signal in an analog form.

A parabolic antenna for receiving a digital broadcast signal from asatellite is connected to the digital BS/CS tuner 300. The digital BS/CStuner 300 receives and selects a target digital broadcast signal on thebasis of a channel selection control signal corresponding to a channelselection instruction from the user, and then supplies the received andselected digital broadcast signal to the recording and reproducingapparatus 100 via the digital input terminal 1. The digital broadcastsignal supplied via the digital input terminal 1 is supplied to amultiplexing/separating circuit 16.

The digital broadcast signal is in a form of a so-called TS (TransportStream) signal formed by packetizing image data (video data), sound data(audio data), and various other data for constructing a broadcastprogram for each channel as a program transmission path, together withvarious control data such as channel selection information referred toas PSI (Program Specific Information), EPG (Electronic Program Guide)data for forming an electronic program guide table and the like, andmultiplexing the packetized data for transmission.

An identifier (ID) is added to each packet. The identifier makes itpossible to extract PSI data and EPG data, and extract image packets andsound packets for constructing the same program.

The multiplexing/separating circuit 16 extracts PSI and EPG data fromthe TS signal received from the digital BS/CS tuner 300, and thensupplies the PSI and EPG data to the CPU 40 to allow program selection.Also, the multiplexing/separating circuit 16 forms an electronic programguide table, and then outputs the electronic program guide table so asto be displayed in response to an instruction from the user, thusenabling program selection, unattended recording and the like throughthe electronic program guide table.

When an instruction to record a selected program is given, themultiplexing/separating circuit 16 extracts video packets and audiopackets of the target program selected by the user from the TS signalreceived from the digital BS/CS tuner 300, and forms a new TS signalcomprising the video packets and audio packets and necessary controldata. The multiplexing/separating circuit 16 records the new TS signalonto the recording medium 18 via a buffer control circuit 17.

At the same time, the multiplexing/separating circuit unit 16 forms avideo ES (Elementary Stream) from the video packets of the targetprogram extracted from the TS signal received from the digital BS/CStuner 300, and then supplies the video ES to an MPEG (Motion PictureExperts Group) video decoder 23. The multiplexing/separating circuit 16also forms an audio ES (Elementary Stream) from the audio packets of thetarget program extracted from the TS signal received from the digitalBS/CS tuner 300, and then supplies the audio ES to an MPEG audio decoder19.

The MPEG audio decoder 19 decodes the audio ES supplied thereto, therebyobtaining baseband audio data, and then supplies the baseband audio datato an audio signal post-processing circuit 20. The MPEG decoder 23decodes the video ES supplied thereto, thereby obtaining baseband videodata, and then supplies the baseband video data to a video signalpost-processing circuit 24.

The video signal post-processing circuit 24 performs switching betweenthe video data from the MPEG video decoder 23 and video data from avideo signal pre-processing circuit 13 to be described later, performsscreen synthesis, filter processing and the like, and then supplies thevideo data after the processing to a combining circuit 26.

As will also be described later, the combining circuit 26 is suppliedwith the video data from the video signal post-processing circuit 24,video data of a reduced still image referred to as a thumbnail or thelike from a still image generating circuit 25, graphics and text datafor screen display formed by the CPU 40, and the like. The combiningcircuit 26 performs processing to combine these pieces of data, partlyoverlap a display, and the like, and then supplies the video data afterthe processing to an NTSC encoder 27.

The NTSC encoder 27 converts the video data (component digital signals)supplied thereto into a YC signal, performs D/A conversion, therebygenerating an analog composite video signal (Cps) and an analog separatevideo signal (S), and then outputs the signals through the analog videooutput terminals 28 and 29.

In the meantime, the audio signal post-processing circuit 20 performsswitching between the audio data from the MPEG audio decoder 19 andaudio data from an audio signal pre-processing circuit 6, performsfilter processing, fade processing, speech speed conversion processingand the like, and then supplies the audio data after the processing toan audio D/A converter 21. The audio D/A converter 21 converts the audiodata supplied thereto into an analog audio signal, and then outputs theanalog audio signal through the analog audio output terminal 22.

The monitor receiver 200 is connected in a stage succeeding the analogaudio output terminal 22 and the analog video output terminals 28 and29. Sound corresponding to the analog audio signal output through theanalog audio output terminal 22 is emitted from the speaker provided tothe monitor receiver 200. An image corresponding to the analog videosignals output through the analog video output terminals 28 and 29 isdisplayed on the display screen of the monitor receiver.

Thus, the recording and reproducing apparatus 100 according to thepresent embodiment can extract video data and audio data of a targetprogram from a digital broadcast signal supplied from the BS/CS tuner300, record the video data and audio data onto the recording medium 18,and at the same time, form an analog video signal and an analog audiosignal and output the analog video signal and the analog audio signal.That is, the recording and reproducing apparatus 100 makes it possibleto view the target program provided as the digital broadcast signalwhile recording the program onto the recording medium 18.

[Use of Digital Input and Output]

Also, as described above, a TS signal newly formed in themultiplexing/separating circuit 16 can be output to an external device,such as, for example, another recording device or a personal computer,via a digital interface circuit (hereinafter abbreviated as a digitalI/F circuit) 3 and the digital input/output terminal 2. In this case,the digital I/F circuit 3 converts the digital signal supplied theretointo a digital signal in a form adapted to the external device, and thenoutputs the digital signal.

Conversely, the recording and reproducing apparatus 100 can, forexample, receive via the digital input/output terminal 2 a digitalsignal supplied from the digital video camera 500 or the like via adigital interface, such as an IEEE 1394 digital interface or the like,record the digital signal onto the recording medium 18, form an analogvideo signal and an analog audio signal, and then output the analogvideo signal and the analog audio signal.

Specifically, the digital signal is supplied through the digitalinput/output terminal 2 to the digital I/F circuit 3. The digital I/Fcircuit 3 subjects the digital signal supplied thereto to processing forformat conversion or the like so that the digital signal is adapted to asystem used by the recording and reproducing apparatus 100 according tothe present embodiment, thereby generating a TS signal, and thensupplies the TS signal to the multiplexing/separating circuit 16.

The multiplexing/separating circuit 16 further analyzes and generates acontrol signal and the like, and then forms a TS signal in a format forrecording on the recording medium 18. The multiplexing/separatingcircuit 16 can record the TS signal onto the recording medium 18 via thebuffer control circuit 17, as described above.

The multiplexing/separating circuit 16 forms a video ES and an audio ESfrom the TS signal supplied from the digital I/F circuit 3, and thensupplies the video ES and the audio ES to the MPEG video decoder 23 andthe MPEG audio decoder 19, respectively. Thereby, as described above, ananalog video signal and an analog audio signal can be formed and thenoutput.

[Use of Analog Input]

A description will next be made of the operation of the recording andreproducing apparatus 100 when the recording and reproducing apparatus100 is supplied with a television broadcast signal from the terrestrialtelevision tuner 400 connected to the recording and reproducingapparatus 100 via the analog audio input terminal 4 and, for example,the analog video input terminal 8, records the television broadcastsignal onto the recording medium 18, and outputs the televisionbroadcast signal in an analog form.

The terrestrial television tuner 400 receives, selects, and demodulatesan analog terrestrial broadcast signal, thereby obtaining an analogcomposite video signal (Cps) and an analog audio signal, and thensupplies the analog composite video signal and the analog audio signalto the recording and reproducing apparatus 100. The analog audio signalfrom the terrestrial television tuner 400 is supplied to an A/Dconverter 5 via the analog audio input terminal 4. The analog compositevideo signal (Cps) from the terrestrial television tuner 400 is suppliedto a YC separation circuit 9 via the analog video input terminal 8.Incidentally, an analog separate video signal (S) is supplied to aselector 11 via the analog video input terminal 10.

The YC separation circuit 9 separates the analog composite video signal(Cps) supplied thereto into a luminance signal Y and a color-differencesignal C (performs so-called YC separation), and then supplies theluminance signal Y and the color-difference signal C to the selector 11.The selector 11 is also supplied with the analog separate video signal(S) via the analog video input terminal 10.

The selector 11 selects one of the video signal from the YC separationcircuit 9 and the video signal supplied as the separate video signal viathe analog video input terminal 10 according to an instruction from theCPU 40, and then supplies the selected video signal to an NTSC (NationalTelevision System Committee) decoder 12.

The NTSC decoder 12 subjects the analog video signal input thereto toA/D conversion, chroma decode and other processing, thereby convertingthe analog video signal into digital component video data (video data),and then supplies the digital component video data to a video signalpre-processing circuit 13. Also, the NTSC decoder 12 supplies asynchronization control circuit 15 with a clock generated on the basisof a horizontal synchronizing signal of the video signal input thereto,and the horizontal synchronizing signal, a vertical synchronizingsignal, and a field discrimination signal obtained by sync separation.

The synchronization control circuit 15 generates a clock signal and asynchronizing signal for providing timing necessary in each circuitblock, using each signal supplied to the synchronization control circuit15 as a reference, and then supplies the clock signal and synchronizingsignal to each circuit block.

The video signal pre-processing circuit 13 subjects the video data inputthereto to various video signal processing, such as prefilter processingand the like, and then supplies the video data to an MPEG video encoder14 and the video signal post-processing circuit 24.

The MPEG video encoder 14 subjects the video data from the video signalpre-processing circuit 13 to encode processing, such as block DCT(Discrete Cosine Transform) and the like, thereby generating a video ES,and then supplies the video ES to the multiplexing/separating circuit16.

In the meantime, the A/D converter 5 converts the audio signal suppliedto the A/D converter 5 via the audio input terminal 4 into digital audiodata, and then supplies the digital audio data to an audio signalpre-processing circuit 6. The audio signal pre-processing circuit 6subjects the audio data supplied thereto to filter processing, and thensupplies the audio data to an MPEG audio encoder 7.

The MPEG audio encoder 7 compresses the audio data supplied thereto inaccordance with an MPEG format, thereafter generating an audio ES, andthen supplies the audio ES to the multiplexing/separating circuit 16 asin the case of the video data.

At a time of recording, the multiplexing/separating circuit 16multiplexes the video ES from the MPEG video encoder 14, the audio ESfrom the MPEG audio encoder 7, and various control signals.Specifically, the multiplexing/separating circuit 16 at the time ofrecording subjects the MPEG video ES and the MPEG audio ES input theretoto multiplexing processing together with the various control signals,and thereby generates a TS signal for an MPEG system, for example. TheTS signal generated in the multiplexing/separating circuit 16 isrecorded on the recording medium 18 via the buffer control circuit 17.

As shown in FIG. 2, the audio data from the audio signal pre-processingcircuit 6 is supplied to the MPEG audio encoder 7, and also is suppliedto the audio signal post-processing circuit 20. The video data from thevideo signal pre-processing circuit 13 is supplied to the MPEG videoencoder 14, and also is supplied to the video signal post-processingcircuit 24.

The audio signal post-processing circuit 20 and the D/A converter 21function to form an analog audio signal and output the analog audiosignal via the audio output terminal 22. The video signalpost-processing circuit 24, the combining circuit 26, and the NTSCencoder 27 function to form an analog video signal and output the analogvideo signal via the analog video output terminals 28 and 29.

Thus, in parallel with processing for converting the analog signalssupplied via the analog audio input terminal 4 and the analog videoinput terminal 8 or 10 into digital signals and recording the digitalsignals onto the recording medium 18, the video data and audio databeing recorded can be reproduced and output.

Further, the video signal and the audio signal input in the analog formcan also be multiplexed as video data and audio data and then output tothe external digital device via the digital I/F circuit 3 and thedigital input/output terminal 2.

[Reproduction from Recording Medium]

A description will next be made of the operation of the recording andreproducing apparatus 100 according to the present embodiment when therecording and reproducing apparatus 100 reproduces video data and audiodata recorded on the recording medium 18 as described above. The CPU 40effects control to read a target TS signal to be reproduced from therecording medium 18 and supply the TS signal to themultiplexing/separating circuit 16 via the buffer control circuit 17.

The multiplexing/separating circuit 16 at the time of reproductionseparates a video ES and an audio ES from the TS signal read from therecording medium 18, and then supplies the separated audio ES to theMPEG audio decoder 19 and the video ES to the MPEG video decoder 23.

The processing of the circuit units from the MPEG audio decoder 19 ondown and the processing of the circuit units from the MPEG video decoder23 on down are as described above regarding the use of digital input.Specifically, an analog audio signal is formed from the audio ESsupplied to the MPEG audio decoder 19 and then output, and an analogvideo signal is formed from the video ES supplied to the MPEG videodecoder 23 and then output.

Thereby, an image and sound corresponding to the video data and theaudio data read from the recording medium 18 can be output for viewingvia the monitor receiver 200 connected in a stage succeeding the analogaudio output terminal 22 and the analog video output terminals 28 and29.

[Use of Communication Connection Terminal and Communication Interface]

The recording and reproducing apparatus 100 according to the presentembodiment has the communication I/F 30 and the communication connectionterminal 31, as described above, so that, for example, the recording andreproducing apparatus 100 can be connected to a network, such as theInternet or the like, via a telephone line or the like to obtain variousdata via the network and send various data to the network.

The various data that can be sent and received includes not only videodata and audio data, but also various programs, text data and the like.The video data and audio data can be recorded on the recording medium 18via the multiplexing/separating circuit 16.

Also, video data and audio data obtained via the communication networkcan be reproduced and used by utilizing the multiplexing/separatingcircuit 16, an audio signal reproducing system comprising the MPEG audiodecoder 19, the audio signal post-processing circuit 20, the D/Aconverter 21, and the audio output terminal 22, and a video signalreproducing system comprising the MPEG video decoder 23, the videosignal post-processing circuit 24, the still image generating circuit25, the combining circuit 26, the NTSC encoder 27, and the video outputterminals 28 and 29.

Further, a program, control data and the like for use in the recordingand reproducing apparatus 100 according to the present embodiment can beprovided via the network, recorded and retained in the EEPROM 43 or thelike, and used as required.

For example, it is possible via the communication network to upgrade thefunctions of the recording and reproducing apparatus according to thepresent embodiment and obtain EPG data and the like for BS digitalbroadcast and CS digital broadcast in advance to create an electronicprogram guide table in advance.

It is to be noted that while in the present embodiment, video data andaudio data are compressed by the MPEG system, it is possible to useanother compression system and process non-compressed video data andaudio data without data compression.

[Edit Function]

The recording and reproducing apparatus 100 according to the presentembodiment has an edit function so that while reproducing a broadcastprogram or the like recorded on the recording medium 18 and checking thereproduced image, a chapter mark can be put as a mark around an imageforming a target scene by a simple operation.

Reduced still images are displayed in a scrollable mode with referenceto the image provided with the chapter mark. A start and an end of thetarget scene are determined accurately in a frame unit, that is, in animage unit, thereby precisely specifying a start and an end of a signalsection to be edited, so that target editing can be performed on thespecified image section.

In this case, a part for forming an image signal for displaying thereduced still images is the still image generating circuit 25 shown inFIG. 2. The still image generating circuit 25 has a buffer memory ofabout 4 Mbytes, for example. Under control of the CPU 40, the stillimage generating circuit 25 obtains target image data from image datarecorded on the recording medium 18 via the MPEG video decoder 23, andthen forms an image signal for displaying the reduced image.

The recording and reproducing apparatus 100 according to the presentembodiment performs the edit function without the need for switching therecording and reproducing apparatus to an edit mode each time as withthe edit function of a conventional recording and reproducing apparatus.As will be described later in detail, the recording and reproducingapparatus 100 according to the present embodiment enables various editfunctions to be used in the reproduction mode, making it possible tochange from a reproduction operation to an edit operation withoutinterruption of the operation, or in a so-called seamless manner.

The edit function of the recording and reproducing apparatus 100according to the present embodiment will be described in the following.As described above, the recording medium 18 of the recording andreproducing apparatus 100 is a hard disk, and is able to record a largeamount of data. Supposing that one set of information of one televisionprogram or the like is referred to as a title, for example, therecording medium 18 can store and retain sets of information includingimage information for a plurality of titles.

That is, in the present specification, a title is a set of imageinformation, sound information and the like handled as one set (onepiece) of information of one broadcast program, one movie or the like.As described above, the recording medium 18 is able to recordinformation for a plurality of titles.

When a title to be reproduced is selected from among titles recorded andretained on the recording medium 18 and an instruction to reproduce thetitle is given, a set of information (TS signal), including imageinformation of the title, is read from the recording medium 18, and isreproduced by the function of the multiplexing/separating circuit 16 andthe functions of the MPEG video decoder 23, the video signalpost-processing circuit 24, the combining circuit 26, and the NTSCencoder 27, as described above. The reproduced image information issupplied to the monitor device 200, and the reproduced image isdisplayed on the display screen 201 of the monitor device 200.

Then, when an image of a target scene is displayed on the display screen201 and a user recognizes the image, the user presses a chapter mark key154 of the remote control 150 to put a so-called chapter mark to theimage of the target scene. FIG. 3 is a diagram of assistance inexplaining an example of a displayed image 201G on the display screen201 immediately after an operation for putting a chapter mark.

When the chapter mark key 154 is pressed, since the CPU 40 of therecording and reproducing apparatus 100 knows which image is currentlybeing reproduced by the time code or the frame number of the image, theCPU 40 obtains the time code information or the frame number asinformation for identifying the image being displayed on the displayscreen 201 of the monitor receiver 200 at a point in time when thechapter mark key 154 is pressed, and, for example, records theinformation together with information for identifying the title beingreproduced as chapter mark information in a file provided on therecording medium 18.

Further, when the CPU 40 detects that the chapter mark key 154 ispressed, as shown in FIG. 3, the CPU 40 displays a time line 201Tindicating a total reproduction time corresponding to a total amount ofdata of the title being reproduced at that time, and also displaystriangular marks M1, M2, M3, . . . indicating positions of imagesprovided with chapter marks in the total reproduction time of the title.

That is, a chapter mark is attached to image data in a unit of oneframe, and a triangular mark is displayed for indicating the position ofthe image provided with the chapter mark.

The time line 201T and the triangular marks M1, M2, M3, . . . are erasedafter being displayed for a certain time after the pressing of thechapter mark key 154, to return to display of only the originaldisplayed image 201G. As shown in FIG. 3, the chapter mark key 154 canbe pressed any number of times as required within one title, so that aplurality of chapter marks can be provided within one title.

Thus, during reproduction of a target title, it is possible to specify,for example, only one or more necessary scenes occurring at randomwithin the title, or conversely, specify only one or more unnecessaryscenes.

Then, using an image provided with a chapter mark as a reference image(edit point), it is possible to perform reproduction from the position(image) provided with the chapter mark; editing such as deleting,moving, or extracting of the image provided with the chapter mark orimages of a section interposed between images provided with a chaptermark; and division of image information with reference to the positionprovided with the chapter mark.

However, since a chapter mark provided by pressing the chapter mark key154 during reproduction of a target title is roughly put to an image ofa target scene, the chapter mark is not necessarily put precisely to astart image or an end image of the target scene.

Accordingly, after at least one chapter mark is provided, the recordingand reproducing apparatus 100 is changed to a mode for receivingoperations regarding the chapter mark by operating a predeterminedoperating key on the remote control 150 or by displaying a predeterminedmenu and selecting an item, such as, for example, “edit marks”, from themenu. In this case, an image displayed on the display screen 201 ispaused. That is, the image displayed on the display screen 201 becomes astill image.

Thereafter, as shown in FIG. 3, the CPU 40 of the recording andreproducing apparatus 100 forms image information for displaying thetime line 201T and triangular marks indicating the position of imagesprovided with chapter marks, and then displays the image information onthe monitor receiver 200 to allow selection of an image provided with achapter mark.

Immediately after the recording and reproducing apparatus 100 is changedto the mode for receiving operations regarding the chapter marks, atriangular mark corresponding to the position of a predetermined image,such as, for example, an image provided with an immediate chapter markor an image provided with a first chapter mark, is selected from amongthe plurality of images already provided with chapter marks.

A target triangular mark on the time line 201T can be selected byoperating a left arrow key 152L or a right arrow key 152R on the remotecontrol 150.

When the target triangular mark is selected by operating the left arrowkey 152L or the right arrow key 152R on the remote control 150 and apredetermined operation is performed, such as, for example, pressing anup arrow key 152U on the remote control 150, the CPU 40 of the recordingand reproducing apparatus 100 determines from the position of thetriangular mark what chapter mark information corresponds to thetriangular mark, and referring to the chapter mark information recordedand retained on the recording medium 18, identifies an image at theposition indicated by the selected triangular mark.

Then, the CPU 40 obtains image information for forming the identifiedimage (the image at the position indicated by the selected triangularmark) and image information for forming images adjacent to theidentified image from the recording medium 18, and supplies the obtainedimage information to the still image generating circuit 25 via the MPEGvideo decoder 23. The CPU 40 controls the still image generating circuit25 to form an image signal for displaying reduced still images S1, S2,S3, S4, and S5 referred to as thumbnails or the like.

The image signal for displaying the plurality of reduced still imagesgenerated by the still image generating circuit 25, or at least fivereduced still images in the present embodiment, is supplied to thecombining circuit 26, where the image signal is combined with an imagesignal from the video signal post-processing circuit 24. The resultingimage signal is output via the NTSC encoder 27, and supplied to themonitor receiver 200, whereby the images are displayed on the displayscreen 201 of the monitor receiver 200.

In an example shown in FIG. 4, the triangular mark M1 is selected, andthe reduced still images for five frames are displayed, that is, withreference to the image at the position indicated by the triangular mark(S3), the images (S1 and S2) for two frames preceding the image S3 andthe images (S4 and S5) for two frames succeeding the image S3 aredisplayed.

In the example shown in FIG. 4, an outer frame of the reduced stillimage S3 currently provided with the chapter mark is displayed in athick line, that is, a so-called cursor is positioned at the reducedstill image S3, indicating that the reduced still image S3 is to bemanipulated.

By operating the left arrow key 152L or the right arrow key 152R whenthe reduced still images S1, S2, S3, S4, and S5 are displayed, thecursor is moved to sequentially change the reduced still image to bemanipulated.

FIGS. 5A to 5C are diagrams of assistance in explaining an example ofchanging the reduced still image to be manipulated when the reducedstill images S1 (to be manipulated), S2, S3, S4, and S5 are displayed.Pressing the left arrow key 152L can sequentially move the cursor to theleft.

Thus, pressing the left arrow key 152L twice when the cursor ispositioned at the reduced still image S3 can position the cursor to thereduced still image S1 at the leftmost part of the display screen 201,as shown in FIG. 5A. The reduced still image (the reduced still image atwhich the cursor is positioned) having an outer frame displayed in athick line is to be manipulated. Incidentally, the image provided withthe chapter mark in the state shown in FIG. 5A is displayed as thereduced still image S3, as indicated by an arrow in FIG. 5A.

When the left arrow key 152L is further pressed, the reduced stillimages are scrolled in the direction to the right of the display screen201, as shown in FIG. 5B. An image (S1-1) not displayed in the state ofFIG. 5A and one frame before the reduced still image S1 is displayed asthe reduced still image S1. At this time, the image provided with thechapter mark is displayed as the reduced still image S4, as indicated byan arrow in FIG. 5B.

Thus, pressing the left arrow key 152L can scroll the reduced stillimages by one frame in a direction of going back to the past to select atarget image.

Similarly, pressing the right arrow key 152R can move the cursor in thedirection to the right of the display screen 201. Further pressing theright arrow key after moving the cursor to the reduced still image S5 atthe rightmost part of the display screen 201 can scroll the reducedstill images by one frame in a direction of advancing time to select atarget image.

Then, an enter key 153 on the remote control 150 is pressed to display amenu MN1 for selecting a manipulation on the reduced display image to bemanipulated, as shown in FIG. 5C. In this case, a selection can be madeto either return to selection of a reduced still image or reset thechapter mark.

The resetting of the chapter mark is processing that attaches a newchapter mark to an original image of the selected reduced still imageand deletes the chapter mark attached to the image serving as thereference image this time.

Thus, when the chapter mark is reset in the state shown in FIG. 5B andFIG. 5C, an original image of the reduced still image S1 in FIG. 5B andFIG. 5C is provided with a chapter mark, while the chapter mark attachedto an original image of the reduced still image S4 is deleted.

Specifically, in the case of the example shown in FIG. 5B and FIG. 5C,of the chapter mark information recorded and retained on the recordingmedium 18, the information for identifying the original image of thereduced still image S4 in FIG. 5B and FIG. 5C is changed to informationfor identifying the original image of the reduced still image S1 in FIG.5B and FIG. 5C.

Then, the triangular mark indicating the position of the image whosechapter mark has been deleted is erased, and a new triangular markindicating the position of the image provided with the new chapter markis displayed.

Thus, the recording and reproducing apparatus 100 according to thepresent embodiment makes it possible to attach a chapter mark roughly toan unnecessary scene part, for example, while reproducing and viewing atelevision broadcast program or the like recorded on the recordingmedium 18, and to check the roughly attached chapter mark as appropriateand reattach the chapter mark accurately to a target image.

Then, when an operation is performed to return the processing after achapter mark has been accurately attached to a first image and a lastimage of a target scene, the reduced still images S1, S2, S3, S4, and S5are hidden to return to the display of the still image 201T, the timeline 201T, and the triangular marks M1, M2, M3, . . . as shown in FIG. 3so that reproduction and various editing can be performed with referenceto the images provided with chapter marks.

FIG. 6 is a diagram of assistance in explaining reproduction and variousediting performed with reference to the images provided with chaptermarks. When selecting a triangular mark and performing a predeterminedoperation after returning to the display of the still image 201G, thetime line 201T, and the triangular marks M1, M2, M3, . . . , a menu MN2is displayed for selecting processing that can be performed withreference to the image provided with the selected triangular mark.

By selecting an intended process from the menu MN2, it is possible toperform processing such as deletion of the selected triangular mark,reproduction from the image at the position of the selected triangularmark, specifying two triangular marks and deleting a scene sectionbetween the two triangular marks (A-B deletion), naming the selectedtriangular mark, and the like.

Various other edit processes can be performed, such as specifying twotriangular marks and moving the scene section between the two triangularmarks, dividing image information of a television program or the likewith reference to the image of the selected triangular mark, or thelike.

Thus, the recording and reproducing apparatus 100 according to thepresent embodiment makes it possible to set a chapter mark at the timeof reproduction for viewing and eventually perform editing withreference to the chapter mark, rather than switching the recording andreproducing apparatus 100 to an edit mode and then performing editing aswith the conventional recording and reproducing apparatus.

That is, the reproduction mode and the edit mode are not distinctlydifferent modes, and various edit functions can be used as functionsperformable in the reproduction mode. Thus, ordinary operation forreproduction and viewing and operation for editing can be performedseamlessly, and therefore a usable recording and reproducing apparatusis realized.

The operation of the recording and reproducing apparatus 100 accordingto the present embodiment at the time of reproduction will next bedescribed further with reference to the diagram of FIG. 7 showing anexample of displayed items, and the flowcharts of FIGS. 8 to 10. Theoperation of the recording and reproducing apparatus 100 according tothe present embodiment at the time of reproduction is an application ofan image detecting method according to the present invention, and isperformed by executing an image detecting program at the CPU 40, forexample.

FIG. 7 is a diagram of assistance in explaining an example of itemsdisplayed on the display screen 201 of the monitor receiver 200 by therecording and reproducing apparatus 100 according to the presentembodiment. As described above, the recording and reproducing apparatus100 according to the present embodiment reads and reproduces imageinformation recorded on the recording medium 18 to thereby form andoutput an analog image signal to be supplied to the monitor receiver200, and display an image 201G on the display screen 201 of the monitorreceiver 200.

At the time of reproduction (reproduction mode), an image signal isformed in predetermined timing to display a state display G1, a remotecontrol operable key display G2, a time line 201T, triangular marks M1,M2, M3, . . . , a start point display ST, an end point display ED, areduced still image (thumbnail) S, and menus MN1, MN2, and MNS, as shownin FIG. 7. These items are displayed on the display screen of themonitor receiver 200.

The state display G1 identifies the state of operation of the recordingand reproducing apparatus 100, such as the recording mode, thereproduction mode or the like. The remote control operable key displayG2 identifies remote control operating keys operable at that time.

As described above, the time line 201T indicates the total reproductiontime of the title currently being reproduced (the total amount of dataof the title). The triangular marks M1, M2, M3, . . . displayed in thevicinity of the time line 201T indicate positions of images providedwith chapter marks.

The start point ST indicates the start point of a range-specifiedsection. The end point ED indicates the end point of the range-specifiedsection. Both points are specified in correspondence with a triangularmark. The section between the start point ST and the end point ED is tobe edited, for example, deleted or moved.

As is also shown in FIG. 3 and FIG. 4, the reduced still image S in thepresent embodiment comprises five reduced still images S1, S2, S3, S4,and S5, or comprises reduced still images of an image selected by a userfrom among images provided with chapter marks and images adjacent to theimage selected by the user.

The menu MN1 is provided to select processing on a selected reducedstill image. The menu MN2 is provided to select processing on atriangular mark displayed so as to correspond to a chapter mark. Themenu MNS is provided to select processing performable in thereproduction mode.

During the operation at the time of reproduction to be described withreference to FIGS. 8 to 10, the recording and reproducing apparatus 100according to the present embodiment performs various processesperformable in reproduction processing and the reproduction mode whiledisplaying the display items shown in FIG. 7 as appropriate.

As shown in FIG. 8, when the recording and reproducing apparatus 100according to the present embodiment is turned on and an instruction isinput to display a list of titles, such as television programs or thelike, recorded on the recording medium 18, the CPU 40 refers to, forexample, a directory of the recording medium 18 via the buffer controlcircuit 17, forms an image signal for displaying the list of titlesrecorded on the recording medium 18, and then supplies the image signalto the combining circuit 26 via the multiplexing/separating circuit 16,whereby the title list is displayed on the monitor receiver 200 incombination with the displayed image 201G (step S101).

Then, the CPU 40 of the recording and reproducing apparatus 100 receivesa title selecting input from the user via the remote control 150 or theoperating panel provided on the front panel of the recording andreproducing apparatus 100 (step S102). The CPU 40 also receives anoperating instruction input from the user via the remote control 150 orthe operating panel (step S103).

Then, the CPU 40 determines whether an end instruction has been inputfrom the user as the operating instruction (step S104). When the CPU 40determines in the determination process at step S104 that an endinstruction has been input, the CPU 40 ends the processing representedin FIGS. 8 to 10, and goes into a so-called initial input wait state forreceiving a recording mode selecting input, a title list displayinstruction input or the like.

When the CPU 40 determines in the determination process at step S104that an end instruction has not been input, the CPU 40 determineswhether an input for selecting a target title and an instruction inputfor reproducing the selected title have been input (step S105). When theCPU 40 determines in the determination process at step S105 that notitle has been selected or that no reproduction instruction has beeninput, the CPU 40 repeats the processing from step S102 to receive atitle selecting input and an operating instruction input.

When the CPU 40 determines in the determination process at step S105that an instruction to reproduce a selected title has been input, theCPU 40 controls each of the buffer control circuit 17, themultiplexing/separating circuit 16, the MPEG audio decoder 19, the audiosignal post-processing circuit 20, the D/A converter 21, the MPEG videodecoder 23, the video signal post-processing circuit 24, the combiningcircuit 26, and the NTSC encoder 27 to start reproducing the titleselected at step S102 (step S106).

Incidentally, the state display G1 and the remote control operable keydisplay G2 described above with reference to FIG. 7 are displayed for acertain time at step S106, for example about a few seconds, to identifythe reproduction mode and the usable operating keys on the remotecontrol 150 and the operating panel.

The CPU 40 then receives an instruction input from the user via theremote control 150 or the operating panel (step S107). Instructionsreceivable at step S107 include an instruction for attaching a chaptermark by pressing the chapter mark key 154, an instruction for displayinga submenu, and other instructions to pause, fast forward, fast reverse,stop reproduction and the like.

The CPU 40 then determines whether the instruction received at step S107is an instruction for attaching a chapter mark (step S108). When the CPU40 determines in the determination process at step S108 that aninstruction for attaching a chapter mark has been received, the CPU 40obtains a time code or a frame number for identifying an image displayedon the display screen 201 of the monitor receiver 200 when theinstruction was received (step S109).

After obtaining the time code or the like, the CPU 40 records on therecording medium 18 title information indicating the title currentlybeing reproduced and the time code or the like of image informationforming the title and provided with the chapter mark in association witheach other (step S110). The processing from step S107 is then repeatedto allow a chapter mark to be attached to a plurality of images (aplurality of positions) of the same title.

When the CPU 40 determines in the determination process at step S108that the received instruction is not an instruction for attaching achapter mark, the CPU 40 determines whether the instruction is aninstruction to display a submenu MNS (step S111). When the CPU 40determines in the determination process at step S111 that theinstruction input is not an instruction to display a submenu, the CPU 40performs other processes specified by the user, for example, processesto pause, fast forward, fast reverse, stop reproduction and the like(step S112). When the CPU 40 determines in the determination at stepS111 that the instruction input is an instruction to display a submenuMNS, the CPU 40 proceeds to the processing represented in FIG. 9, anddisplays the submenu MNS (step S113). The submenu MNS is to select “markediting” to edit chapter marks attached to images, “title protection” toprevent accidental deletion of the already recorded title, “titledeletion” to delete the already recorded title, and the like.

The CPU 40 then receives a selecting input from the user via the remotecontrol 150 or the operating panel provided on the front panel of therecording and reproducing apparatus 100 (step S114). The CPU 40 thendetermines whether the selecting input received at step S114 is aninstruction to perform “mark edit” (step S115).

When the CPU 40 determines in the determination process at step S115that the received selecting input is not an instruction to perform “markedit,” the CPU 40 performs selected processes such as “titleprotection,” “title deletion” or the like (step S116).

When the CPU 40 determines in the determination process at step S115that “mark edit” has been selected, the CPU 40 controls themultiplexing/separating circuit 16, the MPEG video decoder 23, the videosignal post-processing circuit 24, the combining circuit 26, and theNTSC encoder 27 to pause the displayed image 201G (step S117).

Next, the CPU 40 forms an image signal for displaying a time line 201Tand triangular marks M1, M2, M3, M4, . . . , and supplies the imagesignal to the multiplexing/separating circuit 16 and then to thecombining circuit 26, to display the time line 201T and the triangularmarks M1, M2, M3, . . . on the display screen 201 of the monitorreceiver 200 with an immediate triangular mark in a selected state (stepS118).

The CPU 40 then receives a key input from the user via the remotecontrol 150 or the operating panel (step S119). With the recording andreproducing apparatus 100 according to the present embodiment, inputkeys operable at step S119 are the up arrow key 152U, the enter key 153,and the left and right arrow keys 152L and 152R.

The CPU 40 then determines the input key operated at step S119 (stepS120). When the CPU 40 determines at step S120 that the operated inputkey was the up arrow key 152U, the CPU 40 determines that an instructionto display reduced still images (display thumbnails) was given. The CPU40 extracts chapter mark information as information for identifying animage corresponding to the currently selected triangular mark. On thebasis of the chapter mark information, the CPU 40 reads image data ofthe image corresponding to the currently selected triangular mark andimages adjacent thereto from the recording medium 18. The CPU 40 formsthe reduced still images (thumbnails) S. The CPU 40 supplies the reducedstill images (thumbnails) S to the monitor receiver to display thereduced still images (thumbnails) S on the display screen of the monitorreceiver (step S121).

The CPU 40 then receives a key input to the reduced still imagesdisplayed as thumbnails (step S122). Input keys operable at step S122are a down arrow key 152D, the enter key 153, and the left and rightarrow keys 152L and 152R.

The CPU 40 determines the input key received at step S122 (step S123).When the CPU 40 determines that the down arrow key 152D was operated,the CPU 40 determines that an instruction to hide the displayedthumbnails S was given, and hides the displayed thumbnails (step S124).The CPU 40 then repeats the processing from step S119.

When the CPU 40 determines in the determination process at step S123that the received input key was the enter key, the CPU 40 forms an imagesignal for displaying the menu MN1, and then supplies the image signalto the monitor receiver for display (step S125).

When the CPU 40 determines in the determination process at step S123that the received input key was the left key 152L or the right key 152R,the CPU 40 selects a displayed reduced still image as described abovewith reference to FIG. 4 and FIGS. 5A to 5C (step S126). The CPU 40thereafter repeats the processing from step S122.

When the CPU 40 determines in the determination process at step S120that the key input received at step S119 was the enter key 153, the CPU40 forms an image signal for displaying the menu MN2, and then suppliesthe image signal to the monitor receiver for display (step S127). Afterthe processing at step S125 and the processing at step S127, the CPU 40proceeds to processing represented in FIG. 10 as described later.

When the CPU 40 determines in the determination process at step S120that the key input received at step S119 was the left key 152L or theright key 152R, the CPU 40 selects a triangular mark corresponding to animage at the target position on the display already displaying the timeline 201T and the triangular marks M1, M2, M3, . . . (step S128). TheCPU 40 thereafter repeats the processing from step S119.

As shown in FIG. 9 and as described above, after step S125 and stepS127, the CPU 40 proceeds to the processing represented in FIG. 10. TheCPU 40 receives a selection of a function from the menu MN1 displayed atstep S125 shown in FIG. 9 or the menu MN2 displayed at step S127 (stepS129).

At step S129, when the displayed menu is the menu MN1, the menu is forthe reduced still image, and therefore “return” and “reset mark” can beselected, as shown in FIG. 5C. When the displayed menu is the menu MN2,the menu is for the time line and the triangular mark, and therefore“return,” “delete mark,” “delete A-B,” and “reproduce from here” can beselected, as shown in FIG. 6.

When the CPU 40 determines at step S129 that “return” was selected (stepS130), in the case of the menu MN1 being displayed, the CPU 40 repeatsthe processing from step S122 shown in FIG. 9 to receive a key input tothe reduced still images again, and in the case of the menu MN2 beingdisplayed, the CPU 40 repeats the processing from step S119 shown inFIG. 9 to receive a key input to the triangular marks corresponding tochapter marks again.

When the CPU 40 determines at step S129 that mark resetting was selectedfrom the menu MN1 or the CPU 40 determines at step S129 that markdeletion was selected from the menu MN2 (step S131), the CPU 40 firstdeletes from the recording medium 18 the chapter mark informationattached to the image corresponding to the selected triangular mark(step S132).

The CPU 40 then determines whether an instruction for mark resetting wasgiven (step S133). When an instruction for mark resetting was given, theinstruction is an instruction input to the menu MN1 for the selectedreduced still image, as shown in FIG. 7. Therefore, the CPU 40 obtains atime code, for example, as information for identifying an imagecorresponding to the selected reduced still image, and then registers(records) the new time code as chapter mark information on the recordingmedium 18 (step S134).

After the processing at step S134, or when the CPU 40 determines at stepS133 that mark resetting was not selected (deletion of the triangularmark was selected in the menu MN2), the CPU 40 resumes the reproductionof the displayed image 201G, which reproduction was stopped at step S117(step S135). The CPU 40 repeats the processing from the step S107 shownin FIG. 8.

When the CPU 40 determines at step S129 that “delete A-B” was selectedfrom the menu MN2 (step S136), the CPU 40 receives an input forselecting a start point using a displayed triangular mark as aprocessing unit, as shown by the start point ST in FIG. 7, and displaysits position (step S137). Similarly, the CPU 40 receives an input forselecting an end point using a displayed triangular mark as a processingunit, as shown by the end point ED in FIG. 7, and displays its position(step S138).

The CPU 40 then deletes images from the start point selected at stepS137 to the end point selected at step S138 (step S139). The CPU 40thereafter resumes the reproduction of the displayed image 201G, whichreproduction was stopped at step S117 (step S135). The CPU 40 thenrepeats the processing from step S107 shown in FIG. 8.

When the CPU 40 determines at step S129 that “reproduce from here” wasselected from the menu MN2 (step S140), the CPU 40 resumes thereproduction of the title being processed from the image correspondingto the currently selected triangular mark (step S135). The CPU 40 thenrepeats the processing from step S107 shown in FIG. 8.

Thus, the recording and reproducing apparatus 100 according to thepresent embodiment can perform editing as required basically in thereproduction mode, without the need for properly using two differentmodes, that is, the reproduction mode and the edit mode as with theconventional recording and reproducing apparatus. Therefore, therecording and reproducing apparatus 100 according to the presentembodiment obviates the inconvenience of not knowing an operation forshifting to the edit mode, taking time to shift to the edit mode, or thelike.

In addition, editing operations are very easy because operations relatedto editing can be performed by using a very limited number of operatingkeys of the operating device, such as the remote control or the like,for example, the up arrow key 152U, the down arrow key 152D, the leftarrow key 152L, the right arrow key 152R, the enter key 153, and thechapter mark key 154. Therefore, the recording and reproducing apparatus100 obviates the inconvenience of frequently causing erroneousoperation, missing a target scene while being distracted with operation,or the like.

Further, a chapter mark is attached to an image of a target scene, andthe image provided with the chapter mark and images adjacent thereto canbe checked simultaneously as reduced images and displayed in ascrollable manner. Therefore, without making a lot of use ofconventional functions such as fast forward, fast reverse, frame advanceand the like, editing can be performed by accurately specifying an imageof the target scene with reference to the image provided with thechapter mark.

Thus, the recording and reproducing apparatus 100 according to thepresent embodiment makes it possible to perform editing operationsquickly and easily, and hence, to concentrate on the screen (reproducedimage) without being distracted with the operation of the remotecontrol. Further, it is not necessary at all to be aware of the mode,such as the reproduction mode or the edit mode. In addition, preciseediting in a frame unit can be performed, and searching for an editpoint, changing of an edit point and the like can be performed easilywith a frame as the smallest unit while checking images in a frame unit.

Incidentally, when a chapter mark is reset, it is possible to display animage newly provided with the chapter mark on the display screen 201 ofthe monitor receiver 200, and resume reproduction from the image. Also,when A-B deletion is performed, it is possible to resume reproductionfrom an image next to the deleted image section or resume reproductionfrom an image at a position of a next triangular mark.

Further, in mark resetting, when a chapter mark is to be attached to animage already provided with another chapter mark, a warning display,such as, for example, “A chapter mark is already attached”, is displayedor an alarm sound is emitted.

It is further possible to display a list of all images provided withchapter marks. This can be realized by reading all chapter markinformation recorded and retained as a separate file on the recordingmedium 18, reading image data of the images provided with the chaptermarks from the recording medium 18 on the basis of the chapter markinformation, and reproducing the image data.

[First Modification]

The foregoing embodiment allows the attachment of a chapter mark to animage of a target scene at a time of reproduction without stopping thereproduced image displayed on the display screen 201 of the monitorreceiver 200 while checking the reproduced image. Then, after at leastone or more chapter marks are attached, various editing including thechanging (resetting) of a chapter mark is performed with reference to animage provided with the chapter mark. However, the present invention isnot limited to this.

For example, it may be desired to accurately attach a chapter mark to atarget image first in some cases. In such cases, when the chapter markkey 154 is pressed during reproduction of a target title, an image 201Gdisplayed on the display screen of the monitor receiver 200 is made tobe a still image as an image provided with a chapter mark, as shown inFIG. 4, for example.

Then, with the image provided with the chapter mark as a center, reducedstill images of five frame images including two frame images precedingand succeeding the image provided with the chapter mark are displayedfor resetting of the chapter mark or the like. Also, a time line 201Tand a triangular mark in the vicinity of the time line 201T, which markcorresponds to a position of the image provided with the chapter mark,are displayed for deletion of the chapter mark, range specification andthe like.

When a predetermined operation is performed for resuming reproduction,such as pressing a reproduction key, the reproduction of the displayedimage 201G is resumed, and the reduced still images S1, S2, S3, S4, andS5, the time line 201T, and triangular marks M1, M2, M3, . . . areerased.

Thus, each time the chapter mark key 154 is pressed, reduced stillimages, the time line, and triangular marks are displayed to allowresetting and deletion of a chapter mark, and section specification. Itis thereby possible to perform accurate edit processing on a targettitle while reproducing and viewing the title.

Incidentally, also in the first modification, when a chapter mark isreset, it is possible to display an image newly provided with thechapter mark on the display screen 201 of the monitor receiver 200, andresume reproduction from the image. Also, when A-B deletion isperformed, it is possible to resume reproduction from an image next tothe deleted image section or from an image at the position of the nexttriangular mark.

Further, it is possible to include both the mode of adding chapter markswithout stopping the reproduced image at the time of reproduction asdescribed first and the mode of stopping the reproduced image andperforming chapter mark resetting each time a chapter mark is added, asdescribed in the first modification, so that the user selects and usesboth modes.

[Second Modification]

In the foregoing embodiment, reduced still images are displayed so as tooverlap the display of a moving image on the display screen 201 of themonitor receiver 200. However, the present invention is not limited tothis. For example, as shown in FIG. 11, a moving image display area 201Mand a reduced image display area 201S may be separated from each otheron the display screen 201 so as not to overlap each other.

In this case, the moving image display area 201M displays the reproducedimage of a title recorded on the recording medium 18, while the stillimage display area 201S displays reduced still images referred to asthumbnails or the like. Thus, the whole of the reproduced image of thetitle can be viewed without being hidden by the reduced still images andthe like.

Incidentally, as shown in FIG. 12, the reduced image display area 201Smay be made as large as possible to display more reduced still images.Also, the moving image display area may be disposed on a lower side ofthe display screen 201, and the still image display area may be disposedon an upper side of the display screen 201.

Further, the moving image display area may be disposed on a right sideof the display screen 201, and the still image display area may bedisposed on a left side of the display screen 201. Further, the movingimage display area may be disposed on the left side of the displayscreen 201, and the still image display area may be disposed on theright side of the display screen 201. In short, the display screen 201can be divided into the moving image display area and the still imagedisplay area as appropriate.

[Second Embodiment]

The recording and reproducing apparatus according to the firstembodiment as described above makes it possible to attach a chapter markto a target scene or the vicinity thereof during the reproduction of theimage information of a title (one information signal set of a broadcastprogram or the like) recorded on the recording medium, and to accuratelyspecify an edit section with reference to the attached chapter marks fordesired editing. It is thus possible to start edit operation seamlesslyduring the reproduction without being particularly aware of thereproduction mode and the edit mode.

There are cases, however, where a target scene is desired to be found asquickly as possible from a large amount of image information recorded onthe recording medium. There are, for example, cases where a target scenefor editing, such as deletion, extraction, movement or the like, isdesired to be found from a broadcast movie program recorded on therecording medium and a target scene to be edited is desired to be foundfrom image information taken by a video camera over a long period oftime and recorded on the recording medium of the recording andreproducing apparatus.

In such cases, it takes time to find the target scene if reproduction isperformed from the start of the image information recorded on therecording medium and the reproduced image is viewed until the targetscene appears on the display screen of the monitor receiver. So-calledfast forward reproduction to find the target scene is conceivable; this,however, increases a possibility of missing the target scene, and maythus lack reliability.

Accordingly, a recording and reproducing apparatus according to a secondembodiment is provided with a plurality of small areas (sub-imagedisplay areas (child screens)) for displaying a moving image in adisplay screen so that a plurality of moving images of a title recordedon a recording medium are simultaneously reproduced from differentpoints to enable quick finding of a target scene.

An image processing system of the second embodiment is configured so asto be similar to the image processing system of the first embodimentshown in FIG. 1. A recording and reproducing apparatus 600 forming theimage processing system in this case is also configured so as to besubstantially similar to the recording and reproducing apparatus 100according to the first embodiment shown in FIG. 2, except for a displayimage forming circuit 50, as shown in FIG. 13. Hence, parts of therecording and reproducing apparatus 600 shown in FIG. 13 that aresimilar to those of the recording and reproducing apparatus 100 shown inFIG. 2 are identified by the same reference numerals, and detaileddescription thereof will be omitted.

In the recording and reproducing apparatus 600 according to the secondembodiment, the speed of reading image data and the like of a targettitle from the recording medium 18 and the speed of processing by anMPEG video decoder 23 are sufficiently high. Also, the recording andreproducing apparatus 600 has the display image forming circuit 50capable of simultaneously processing not only still images but also aplurality of moving images. The recording and reproducing apparatus 600can thereby simultaneously reproduce a title selected to be reproducedfrom a plurality of different points.

FIRST EXAMPLE

A description will hereinafter be made of a few concrete examples of therecording and reproducing apparatus 600 according to the secondembodiment that makes it possible to quickly detect an image of a targetscene using a moving image display. FIG. 14 is a diagram of assistancein explaining a first example of the recording and reproducing apparatus600 that makes it possible to quickly detect a target scene using amoving image display.

As shown in FIG. 14, a CPU 40 of the recording and reproducing apparatus600 in this example can provide a first moving image display area 201M1,a second moving image display area 201M2, and a third moving imagedisplay area 201M3. The CPU 40 controls a buffer control circuit 17 tostart reading image data from three points: a head point of a targettitle (one information signal set of a broadcast program or the like), apoint ahead of the head point by 10 seconds in reproduction time, and apoint ahead of the head point by 20 seconds in reproduction time. TheCPU 40 supplies each piece of the read image data to the MPEG videodecoder 23 via a multiplexing/separating circuit 16.

The MPEG video decoder 23 decodes each piece of the image data read fromthe three points as start points and supplied via themultiplexing/separating circuit 16. The MPEG video decoder 23sequentially supplies each piece of the decoded image data to thedisplay image forming circuit 50.

The display image forming circuit 50 forms image data for displaying amoving image on the basis of each piece of image data from the threepieces of image data read from the different start points and suppliedto the display image forming circuit 50. The display image formingcircuit 50 supplies the image data to a combining circuit 26.

The combining circuit 26 combines the image data so as to display areproduced moving image corresponding to the image data from the headpoint of the target title in the first moving image display area 201M1,a reproduced moving image corresponding to the image data from the point10 seconds in reproduction time after the head point of the target titlein the second moving image display area 201M2, and a reproduced movingimage corresponding to the image data from the point 20 seconds inreproduction time after the head point of the target title in the thirdmoving image display area 201M3, as shown in FIG. 14.

The combined image data is supplied from the combining circuit 26 to anNTSC encoder 27. The NTSC encoder 27 generates an analog composite videosignal (Cps) and an analog separate video signal (S), and then outputsthese signals through analog video output terminals 28 and 29.

Thus, one title is reproduced from a plurality of points with timedifferences, and an image reproduced from each point is displayed,whereby a target scene can be detected without being missed.Specifically, images from points ahead of that of the first moving imagedisplay area 201M1 are displayed in the second moving image display area201M2 and the third moving image display area 201M3. It is thereforepossible to surely detect an image of a target scene and specify theimage as an edit candidate point.

Further, by setting relatively long intervals between image readingstart points, for example, intervals of a few minutes or a few tens ofminutes, it is possible to detect a plurality of target signalsconcurrently.

Further, quick detection of a target scene can be facilitated bychanging the reproduction speed (display speed) between the moving imagedisplayed in the first moving image display area, the moving imagedisplayed in the second moving image display area, and the moving imagedisplayed in the third moving image display area, for example, bysetting the reproduction speed of the moving image displayed in thesecond moving image display area and the moving image displayed in thethird moving image display area at twice or three times faster than thatof the moving image displayed in the first moving image display area.

The reproduction speed of the moving images is not defined by the speedof reading data from the recording medium or the speed of processingdata, but by the display speed of the moving images. That is, in thepresent specification, the reproduction speed of moving images issynonymous with the display speed of moving images.

The time differences provided between the plurality of moving imagesmay, of course, be different from each other. The number of moving imagedisplay areas provided is not limited to three; two moving image displayareas may be provided or more than two moving image display areas may beprovided.

Further, a reference moving image may be displayed in the first movingimage display area 201M1, a moving image 10 seconds thereafter may bedisplayed in the second moving image display area 201M2, and a movingimage 10 seconds thereafter may be displayed in the third moving imagedisplay area 201M3.

By thus reproducing the same title from a plurality of points with timedifferences and displaying an image reproduced from each point, it ispossible to easily recognize a target image (an image of a target scene)to be displayed in the first moving image display area 201M1 in fastforward or fast reverse, for example, on the basis of moving imagesdisplayed in the second moving image display area 201M2 and the thirdmoving image display area 201M3.

When a chapter mark is attached to the image displayed in the firstmoving image display area 201M1, as in the case of the recording andreproducing apparatus according to the first embodiment, for example,the image displayed in the first moving image display area 201M1 is madestill and frame images (still images) preceding and succeeding the imagedisplayed in the first moving image display area 201M1 are displayed ina reduced image display area 201S in FIG. 14, whereby precise selectionand setting of an edit point can be performed as in the case of thefirst embodiment.

That is, the reduced image display area 201S is used in the same manneras in the foregoing recording and reproducing apparatus 100 according tothe first embodiment. Also, when a chapter mark is set, a time line anda triangular mark indicating the position of an image provided with thechapter mark (edit candidate point) within the title can be displayed onthe display screen as in the case of the recording and reproducingapparatus 100 according to the first embodiment.

The still images displayed in the reduced image display area 201S arealso formed by the display image forming circuit 50. Thus, the displayimage forming circuit 50 can generate the data of the moving imagesdisplayed in the first moving image display area 201M1, the secondmoving image display area 201M2, and the third moving image display area201M3, and also the plurality of still images displayed in the reducedimage display area 201S.

In the description above, the display image forming unit 50 forms allthe data of the images (the data of the moving images) displayed in thefirst moving image display area 201M1, the second moving image displayarea 201M2, and the third moving image display area 201M3. However, thepresent invention is not limited to this. For example, a video signalpost-processing circuit 24 may form the moving image displayed as areference image in the first moving image display area 201M1.

Incidentally, the CPU 40 controls the operation of each of the buffercontrol circuit 17, the multiplexing/separating circuit 16, the MPEGvideo decoder 23, the display image forming circuit 50, the combiningcircuit 26, the NTSC encoder 27 and the like to display the plurality ofmoving images within one screen, as shown in FIG. 14.

In the first example, audio data accompanying the reproduced video data,for example, audio data corresponding to the image displayed in thefirst moving image display area 201M1, can be read from the recordingmedium 18 via the buffer control circuit 17, and reproduced via an MPEGaudio decoder 19, an audio signal post-processing circuit 20, and a D/Aconverter 21.

That is, it is possible to reproduce sound corresponding to the movingimage displayed in the first moving image display area 201M1, soundcorresponding to the moving image displayed in the second moving imagedisplay area 201M2, or sound corresponding to the moving image displayedin the third moving image display area 201M3.

SECOND EXAMPLE

The foregoing first example provides reading start points (reproducingpoints) at predetermined intervals to thereby prevent an image of atarget scene from being missed and to realize quick detection of theimage of the target scene. The second example makes it possible toquickly and easily detect an image of a target scene as an editcandidate point from image data recorded for a long period of time, forexample.

FIG. 15 is a diagram of assistance in explaining an example of an imagedisplayed on the display screen 201 of the monitor receiver by arecording and reproducing apparatus 600 in the second example of thesecond embodiment. When a title to be reproduced is selected from amongtitles (information signal sets of broadcast programs or the like)recorded on a recording medium 18, a CPU 40 of the recording andreproducing apparatus 600 first provides a main image display area 201Mand displays a time line 201T corresponding to the total amount of imagedata of the title selected to be reproduced within the display screen201, as shown in FIG. 15.

In this case, the main image display area 201M, the time line 201T, anda reproduction position specifying mark moving on the time line 201T areformed by the CPU 40 using data stored in a ROM 41, and are thensupplied to a combining circuit 26 via a multiplexing/separating circuit16, for example, whereby the main image display area 201M, the time line201T, and the reproduction position specifying mark are displayed on thedisplay screen of the monitor receiver 200 connected to the recordingand reproducing apparatus 600.

A user of the recording and reproducing apparatus 600 moves thereproduction position specifying mark on the time line 201T byoperating, for example, an arrow key on a remote control 150 using thetime line 201T as a measure, and selects and inputs one or more movingimage reproducing points.

The CPU 40 of the recording and reproducing apparatus 600 displaysreproducing points MK1, MK2, MK3, . . . indicating moving imagereproducing positions at the positions selected and input by the user.Incidentally, an input item for setting a moving image reproducing timemay be provided to set one or more reproducing points by a moving imagereproducing time, that is, a numerical value.

Further, the CPU 40 of the recording and reproducing apparatus 600 formssub-image display areas as reproduced image display areas according tothe number of input moving image reproducing points. The CPU 40 readsimage data for one frame at a position corresponding to an input movingimage reproducing point from the recording medium 18 and then displays aframe image (still image) based on the read image data in a sub-imagedisplay area.

In this case, as with the time line 201T, the reproducing points MK1,MK2, MK3, . . . are formed by the CPU 40, and supplied to the combiningcircuit 26, so that the reproducing points are displayed in the image.Image data for forming a frame image at a position corresponding to eachreproducing point is read from the recording medium 18 by control of theCPU 40, and then supplied to an MPEG video decoder 23 via themultiplexing/separating circuit 16. The image data is subjected to MPEGdecoding by the MPEG video decoder 23, and then supplied to the displayimage forming circuit 50.

Image data for displaying a frame image as a still image in eachsub-image display area is formed by the display image forming circuit50, and is then supplied to the combining circuit 26 to be combined,whereby the frame images at the positions corresponding to thereproducing points are displayed in the sub-image display areas providedwithin one screen.

When a plurality of sub-image display areas are provided, selection of asub-image display area can be made, and the CPU 40 of the recording andreproducing apparatus 600 displays an image identical with an image ofthe sub-image display area at which a cursor is positioned in the mainimage display area 201M. The cursor for the sub-image display area isdisplayed and controlled in the display position by the CPU 40.

In the example shown in FIG. 15, three positions in an early stage, amiddle stage, and a late stage of the title selected to be reproducedare selected as moving image reproducing points. The reproducing pointsMK1, MK2, and MK3 are displayed on the time line 201T, and threesub-image display areas SG1, SG2, and SG3 are provided.

Frame images (still images) at positions corresponding to thereproducing points MK1, MK2, and MK3 are each processed by themultiplexing/separating circuit 16, the MPEG video decoder 23, thedisplay image forming circuit 50, the combining circuit 26, and an NTSCencoder 27 as described above, and are displayed in the respectivesub-image display areas SG1, SG2, and SG3 formed on the display screen.

In the example shown in FIG. 15, the cursor CS for a sub-image displayarea is positioned at the sub-image display area SG1, and the same imageas in the sub-image display area SG1 is displayed in the main imagedisplay area 201M.

Incidentally, in this example, the image displayed in the main imagedisplay area 201M is displayed on the basis of image data formed in avideo signal post-processing circuit 24.

In the state shown in FIG. 15, the images displayed in the main imagedisplay area 201M and the sub-image display areas SG1, SG2, and SG3 arethe frame images (still images) at the positions corresponding to thereproducing points specified by the user.

In this state, by operating the remote control 150, the position of areproducing point can be changed or the cursor CS for the sub-imagedisplay area can be moved to be positioned at another sub-image displayarea. Incidentally, the cursor CS for the sub-image display area can bemoved even after reproduction of the selected title is actually started,as will be described later.

When an instruction to start actual reproduction of the selected titleis given by pressing a reproduction key of the remote control 150 or thelike, the CPU 40 of the recording and reproducing apparatus 600 startsreproducing moving images in the main image display area 201M and thesub-image display areas SG1, SG2, and SG3.

FIG. 16 is a diagram of assistance in explaining an image displayed onthe display screen 201 of the monitor receiver 200 at the time of movingimage reproduction by the recording and reproducing apparatus 600 in thesecond example of the second embodiment. As described above, when aninstruction to reproduce moving images is given, the CPU 40 sequentiallyreads image data at the positions corresponding to the reproducingpoints MK1, MK2, and MK3 from the recording medium 18.

As in displaying still images in the main image display area 201M andthe sub-image display areas SG1, SG2, and SG3, the CPU 40 controls themultiplexing/separating circuit 16, the MPEG video decoder 23, the videosignal post-processing circuit 24, the display image forming circuit 50,the combining circuit 26, and the NTSC encoder 27, and supplies theimage data sequentially read from the recording medium 18 to themultiplexing/separating circuit 16, the MPEG video decoder 23, the videosignal post-processing circuit 24, the display image forming circuit 50,the combining circuit 26, and the NTSC encoder 27, so that the mainimage display area 201M and the sub-image display areas SG1, SG2, andSG3 each display a moving image reproduced from the correspondingreproducing point, as shown in FIG. 16.

Further, the CPU 40 of the recording and reproducing apparatus displaysthe reproducing points MK1, MK2, and MK3 such that each of thereproducing points MK1, MK2, and MK3 moves in a direction ofreproduction in such a manner as to be interlocked with the reproductionof the moving image, as indicated by an arrow in FIG. 16, so that theuser can visually perceive the position in the title being reproduced ofthe image displayed in each of the sub-image display areas SG1, SG2, andSG3. Marks ST1, ST2, and ST3 indicated by dotted lines in FIG. 16represent the respective start points of the reproducing points MK1,MK2, and MK3.

Incidentally, in the example shown in FIG. 16, since the cursor CS forthe sub-image display area is positioned at the sub-image display areaSG1, the main image display area 201M displays the same moving image asthe moving image displayed in the sub-image display area SG1.

Thus, the user of the recording and reproducing apparatus 600 in thesecond example can detect an image of a target scene to be used as anedit candidate point through the moving images from the differentreproducing points displayed in the three sub-image display areas SG1,SG2, and SG3.

When the image of the target scene or an image in the vicinity of thetarget scene is displayed in one of the sub-image display areas SG1,SG2, and SG3, the cursor CS is positioned to the sub-image display areadisplaying the image of the target scene or the image in the vicinity ofthe target scene.

Thereby, the same moving image as in the sub-image display area at whichthe cursor CS is positioned is displayed in the main image display area201M, so that the image of the target scene to be used as an editcandidate point can be detected through the moving image displayed inthe main image display area 201M, which has a display area larger thanthe sub-image display area.

FIG. 17 and FIG. 18 are diagrams of assistance in explaining operationsof the user and the recording and reproducing apparatus 600 when animage to be used as an edit candidate point is selected from amongimages of target scenes.

Suppose that when, as described with reference to FIG. 16, moving imagereproduction from the plurality of reproducing points MK1, MK2, and MK3is started simultaneously and the cursor CS is positioned at thesub-image display area SG1, an image that appears to be in the vicinityof a target scene is displayed in the sub-image display area SG3. Atthis time, the user operates an arrow key on the remote control 150 toposition the cursor positioned at the sub-image display area SG1 to thesub-image display area SG3.

In response to the instruction from the user through the remote control150, the CPU 40 of the recording and reproducing apparatus 600 positionsthe cursor CS to the sub-image display area SG3, and displays the movingimage displayed in the sub-image display area SG3 also in the main imagedisplay area 201M, as shown in FIG. 17.

When an image of the target scene is displayed in the main image displayarea 201M, the user of the recording and reproducing apparatus 600presses a chapter mark key 154 provided on the remote control 150.

When it receives a signal indicating that the chapter mark key 154 hasbeen pressed from the remote control 150, the CPU 40 of the recordingand reproducing apparatus obtains a time code or a frame number, forexample, as information capable of identifying the frame image displayedat that time in the main image display area 201M, and records the timecode or the frame number onto the recording medium 18 as informationindicating an edit candidate point.

At the same time, the CPU 40 displays an edit candidate point mark CN(1)on the time line 201T, indicating the position of the frame image in thetitle at the time the chapter mark key was pressed. The edit candidatepoint mark is displayed in a readily distinguishable form, having, forexample, a color, a shape or the like different from that of areproducing point mark.

As described above, even when the chapter mark key 154 is pressed, thedisplay of the moving images displayed in the main image display area201M and the sub-image display areas SG1, SG2, and SG3 is not stopped,but is continued.

Suppose that thereafter an image that appears to be in the vicinity of atarget scene is displayed in the sub-image display area SG2. At thistime, the user operates an arrow key on the remote control 150 toposition the cursor CS positioned at the sub-image display area SG3, asshown in FIG. 17, to the sub-image display area SG2, as shown in FIG.18.

In response to the instruction from the user through the remote control150, the CPU 40 of the recording and reproducing apparatus 600 positionsthe cursor CS to the sub-image display area SG2, and displays the movingimage displayed in the sub-image display area SG2 also in the main imagedisplay area 201M, as shown in FIG. 18.

When an image of the target scene is displayed in the main image displayarea 201M, the user of the recording and reproducing apparatus 600presses the chapter mark key 154 provided on the remote control 150.

When it receives a signal from the remote control 150 indicating thatthe chapter mark key 154 has been pressed, the CPU 40 of the recordingand reproducing apparatus 600 obtains a time code or a frame number, forexample, capable of identifying the frame image displayed at that timein the main image display area 201M, and records the time code or theframe number onto the recording medium 18 as information indicating anedit candidate point together with title identifying information, forexample.

At the same time, the CPU 40 displays an edit candidate point mark CN(2)on the time line 201T, indicating the position of the frame image in thetitle at the time the chapter mark key was pressed.

Thus, using the images reproduced from the plurality of differentreproducing points and displayed in the different sub-image displayareas, the user can quickly detect images of target scenes as editcandidate points, and register the images as edit candidate points onthe recording medium 18.

When one edit candidate point is selected from among the registered editcandidate point marks CN(1), CN(2), as in the case of the recording andreproducing apparatus 100 according to the first embodiment as describedabove with reference to FIG. 4, FIGS. 5A to 5C and the like, frameimages (still images) in the vicinity of the edit candidate point aredisplayed to determine a final edit point of the target scene and torecord the final edit point on the recording medium 18. Using the finaledit point as a reference point, various editing can be performed.

The operation of the recording and reproducing apparatus 600 in thesecond example of the second embodiment will next be described withreference to the flowcharts of FIG. 19 and FIG. 20. As shown in FIG. 19,when the recording and reproducing apparatus 600 according to the secondembodiment is turned on and an instruction is input to display a list oftitles such as television programs or the like recorded on the recordingmedium 18, the CPU 40 refers to, for example, a directory of therecording medium 18 via a buffer control circuit 17, forms an imagesignal for displaying the list of titles recorded on the recordingmedium 18, and then supplies the image signal to the combining circuit26 via the multiplexing/separating circuit 16, whereby the title list isdisplayed in combination with a displayed image 201G on the monitorreceiver 200 (step S201).

Then, the CPU 40 of the recording and reproducing apparatus 600 receivesa title selecting input from the user via the remote control 150 or anoperating panel provided on the front panel of the recording andreproducing apparatus 600 (step S202). The CPU 40 forms the main imagedisplay area 201M and the time line 201T, and displays the main imagedisplay area 201M and the time line 201T, as shown in FIG. 14 (stepS203).

Next, the CPU 40 of the recording and reproducing apparatus 600 receivesa reproducing point selecting input and an operating instruction inputfrom the user via the remote control 150 or the like (step S204). Then,the CPU 40 determines whether the input from the user is an instructionto end reproduction (step S205).

When the CPU 40 determines in the determination process at step S205that the input received from the user at step S204 is an instruction toend reproduction, the CPU 40 ends the processing represented in FIG. 19,and goes into a state of waiting for an input from the user, forexample. When the CPU 40 determines in the determination process at stepS205 that the input received from the user at step S204 is not aninstruction to end reproduction, the CPU 40 determines whether the inputfrom the user is an input for starting reproduction (step S206).

When the CPU 40 determines in the determination process at step S206that the input from the user is not an input for starting reproduction,the CPU 40 in this example repeats the processing from step S202 toreceive a title selecting input, a reproducing point selecting input,and an operating instruction input.

When the CPU 40 determines in the determination process at step S206that the input received from the user at step S204 is an input forstarting reproduction, the CPU 40 provides sub-image display areasaccording to the number of reproducing points selected and input by theuser, and starts reproducing moving images from each of the reproducingpoints, as described above (step S207).

The CPU 40 then receives an instruction input from the user, such as anedit candidate point setting input, a cursor moving instruction input,an edit candidate point selecting input or the like (step S208). The CPU40 determines whether the received instruction is an edit candidatepoint setting input(step S209).

When the CPU 40 determines in the determination process at step S209that the instruction received from the user was an edit candidate pointsetting input, the CPU 40 obtains a time code, a frame number or thelike as information for identifying the image displayed in the mainimage display area (step S210). The CPU 40 then records on the recordingmedium 18 the information obtained at step S210 for identifying theimage and information for identifying the title being reproduced (titleinformation) in association with each other (step S211). The processingfrom step S208 is then repeated.

When the CPU 40 determines in the determination process at step S209that the instruction received from the user was not an edit candidatepoint setting input, the CPU 40 determines whether the instructionreceived from the user was an instruction for moving the cursor CS to asub-image display area (step S212).

When the CPU 40 determines in the determination process at step S212that the input received from the user at step S208 was an instructionfor moving the cursor CS to a sub-image display area, the CPU 40 movesthe cursor CS to the sub-image display area in response to theinstruction from the user (step S213).

The CPU 40 then changes the image displayed in the main image displayarea 201M to the same image as in the sub-image display area at whichthe cursor CS is positioned (step S214). The processing from step S208is thereafter repeated.

When the CPU 40 determines in the determination process at step S212that the input received from the user at step S208 was not aninstruction for moving the cursor CS to a sub-image display area, theCPU 40 proceeds to the processing represented in FIG. 20. The CPU 40determines whether the input received from the user at step S208 was aninput for selecting an edit candidate point registered in response to aninstruction from the user (step S215).

When the CPU 40 determines in the determination process at step S215that the input received from the user at step S208 was an input forselecting an edit candidate point, the CPU 40 stops the reproduction ofthe moving images, reads information from the recording medium 18 foridentifying the frame image of the selected edit candidate point, readsimage data for forming the frame image of the edit candidate point andimage data for a plurality of frame images adjacent to the frame imageof the edit candidate point from the recording medium 18, and displaysthe frame images as still images (step S216).

The processing at step S216 is performed via the multiplexing/separatingcircuit 16, the MPEG video decoder 23, the display image forming circuit50, the combining circuit 26, and the NTSC encoder 27. The display imageforming circuit 50 can form image data for displaying moving images in aplurality of sub-image display areas and also form image data fordisplaying still images (thumbnails), as shown in FIG. 4 and FIGS. 5A to5C for the first embodiment.

As with the recording and reproducing apparatus 100 according to thefirst embodiment, the recording and reproducing apparatus 600 accordingto the second embodiment can display the still images in a scrollablemanner, as shown in FIG. 4, for example. The CPU 40 then receives aninput for selecting the frame image to be used as a final edit pointfrom the plurality of still images displayed with reference to theselected edit candidate point (step S217).

In the selecting input at the step S217, as in the case of the recordingand reproducing apparatus according to the first embodiment, a stillimage selecting cursor positioned at one of the plurality of stillimages displayed with reference to the selected edit candidate point ismoved in response to an instruction from the user, whereby an image ofthe final edit point can be selected.

The CPU 40 determines the input key received at step S217 (step S218).When the CPU 40 determines in the determination process at step S218that the received input key was a down key (down arrow key), the CPU 40determines that edit point selection has not been made, and resumes thedisplay of moving images in the main image display area and thesub-image display areas, which display was stopped at step S216 (stepS221). The CPU 40 then repeats the processing from step S208 shown inFIG. 19.

When the CPU 40 determines in the determination process at step S218that the input key received at step S217 was an enter key, the CPU 40sets the frame image selected this time as an edit point in place of theedit candidate point selected at step S215, and obtains information foridentifying the frame image (step S219).

The CPU 40 then records the title information and the information foridentifying the frame image obtained at step S219 as edit pointinformation onto the recording medium 18 (step S220). Then, the CPU 40resumes the display of moving images in the main image display area andthe sub-image display areas, which display was stopped at step S216(step S221). The CPU 40 then repeats the processing from step S208 shownin FIG. 19.

When the CPU 40 determines in the determination process at step S218that the input key received at step S217 was a left or right key (a leftarrow key or a right arrow key), the CPU 40 determines that aninstruction to change the selected still image, that is, an instructionto move the cursor positioned at the still image, was given. The CPU 40selects a displayed still image (thumbnail) by moving the cursor (stepS222). The CPU 40 thereafter repeats step S217.

When the CPU 40 determines in the determination process at step S215that the input received from the user at step S208 was not an input forselecting an edit candidate point, the CPU 40 performs processingcorresponding to the instruction received from the user (step S223). Atstep S223, of various processes such as pause, fast forward, fastreverse, stop reproduction and the like, the process corresponding tothe request from the user is performed.

Thus, the recording and reproducing apparatus 600 in the second exampleof the second embodiment makes it possible to quickly find (detect) animage of a target scene by specifying a plurality of differentreproducing points for one title and starting reproduction of movingimages simultaneously from the plurality of different reproducingpoints.

When the user detects an image of the target scene, the image isspecified as an image of an edit candidate point, and the image of theedit candidate point and images adjacent to the image of the editcandidate point are displayed as still images to enable selection of anaccurate edit point. Then, information for identifying an image of theselected edit point is obtained and thereafter recorded on the recordingmedium 18 as edit candidate point information. Using the selected editpoint, various editing of a section between edit points, such asdeletion, movement, extraction and the like, can be performed.

[First Modification of Second Example]

The recording and reproducing apparatus in the second examplesimultaneously reproduces a plurality of moving images from a pluralityof different reproducing points, as shown in FIGS. 15 to 18. It istherefore conceivable that a proceeding reproducing point may catch upwith an edit candidate point set at a position temporally ahead of theproceeding reproducing point. In this case, reproduction after asucceeding reproduction start point is performed for a second time.

Directing attention to this point, a recording and reproducing apparatusas a modification of the second example simultaneously reproducesportions yet to be reproduced and selects an edit point with referenceto an edit candidate point that a proceeding reproducing point hascaught up with.

FIG. 21 is a diagram of assistance in explaining processing when aproceeding reproducing point catches up with an edit candidate point setahead of the proceeding reproducing point in the recording andreproducing apparatus in the second example of the second embodiment. Asin the example described with reference to FIG. 17 and FIG. 18, supposethat three reproducing points MK1, MK2, and MK3 with reproduction startpoints ST1, ST2, and ST3 are specified and then reproduction is started.

Then, the cursor CS is positioned at the sub-image display area SG3, andan edit candidate point CN(1) is set after ST3. Further, the cursor CSis positioned at the sub-image display area SG2, and an edit candidatepoint CN(2) is set after ST2. Suppose that reproduction processing iscontinued with the cursor CS positioned at the sub-image display areaSG2, and that the reproducing point MK2 has caught up with the editcandidate point CN(1) set ahead, as shown in FIG. 21.

The CPU 40 of the recording and reproducing apparatus 600 can determinewhether the proceeding reproducing point has thus caught up with theedit candidate point set ahead, for example, by monitoring time codes orframe numbers of frame images of the edit candidate point and thereproducing point and determining that the time codes or frame numbersof the frame images of the edit candidate point and the reproducingpoint coincide with each other.

In the example shown in FIG. 21, when detecting that the proceedingreproducing point MK2 has caught up with the edit candidate point CN(1)set ahead, the CPU 40 displays an image of the edit candidate pointCN(1) and images adjacent to the edit candidate point CN(1) as a stillimage in the sub-image display area SG2. Incidentally, moving imagereproduction is continued in the sub-image display areas SG1 and SG3other than the sub-image display area SG2 displaying the imagecorresponding to the reproducing point MK2.

When the cursor CS is positioned at the sub-image display areadisplaying the moving image corresponding to the reproducing point thathas caught up with the edit candidate point, the still image displayedin the sub-image display area is also displayed in the main imagedisplay area 201M. In the example shown in FIG. 21, the still imagedisplayed in the sub-image display area SG2 is also displayed in themain image display area 201M.

In the example shown in FIG. 21, the edit candidate point is CN(1).Image data for forming four frame images of two frames preceding theedit candidate point CN(1) and two frames succeeding the edit candidatepoint CN(1) is read. As shown in the main image display area 201M inFIG. 21, the image CN(1) of the edit candidate point and the imagesCN(1)−2, CN(2)−1, CN(1)+1, and CN(1)+2 adjacent to the image CN(1) aredisplayed as thumbnails.

As shown in FIG. 21, in a first stage, a cursor MCS is positioned at adisplay area for the image CN(1) of the edit candidate point displayedin the main image display area 201M, and the image at which the cursorMCS is positioned is also displayed in a large size in the entiresurface of the main image display area 201M.

As in the case of the foregoing first embodiment, the cursor MCS can bemoved by operating the left arrow key or the right arrow key on theremote control 150, for example, and a frame image at which the cursorMCS is positioned can be selected and registered as an edit point.

Hence, as shown in FIG. 21, when the down arrow key is pressed or nooperation is performed for more than a predetermined time after thestill images are displayed without pressing the enter key for selectingan edit point, the left arrow key, or the right arrow key, moving imagereproduction is resumed in the sub-image display area SG2 and the mainimage display area 201M displaying the still images.

FIG. 22 is a diagram of assistance in explaining a case where the cursorCS is not positioned at the sub-image display area SG2 displaying themoving image corresponding to the reproducing point MK2 that has caughtup with the edit candidate point CN(1). In this case, the image at theposition corresponding to the edit candidate point CN(1), the image ofthe edit candidate point CN(1), and the adjacent images are displayed asthumbnails only in the sub-image display area SG2.

However, since, as described above, an edit point can be determined byselecting a still image only through the main image display area 201M,edit point selection cannot be made unless the cursor CS is positionedat the sub-image display area SG2, and after passage of a predeterminedtime, moving image reproduction is resumed in the sub-image display areaSG2, for example.

Incidentally, in this example, since edit point selection andregistration can be performed only through the main image display area201M, it is not necessary to display images of an edit candidate pointand the vicinity thereof as so-called thumbnails in a sub-image displayarea as in the display example of FIG. 22.

FIG. 23 is a diagram of assistance in explaining the operation of therecording and reproducing apparatus after an edit point is registeredwith reference to the reproducing point that has caught up with the editcandidate point. In the state shown in FIG. 21, an edit point isselected and registered by positioning the cursor MCS to a target stillimage of the five still images displayed as thumbnails in the main imagedisplay area 201M by operating the left arrow key or the right arrow keyon the remote control 150, and pressing the enter key.

In this case, an edit point DC(1) is set on the recording medium 18 inplace of the immediate edit candidate point CN(1). Then, as shown inFIG. 23, the determined edit point DC(1) is shown on the time line 201T,and thereafter moving image reproduction from the reproducing point MK2is resumed.

While the edit point is registered to replace the edit candidate pointin this case, both the edit candidate point and the edit point can bedisplayed in a distinguishable manner, by, for example, displaying marksindicating the edit candidate point CN(1) and the edit point DC(1) indifferent colors.

Also, the CPU 40 monitors the time interval between the reproducingpoint and the edit candidate point, and displays the message “◯◯ secondsto go to edit candidate point,” for example, before the reproducingpoint catches up with the edit candidate point. The user can thereby setthe cursor CS to a corresponding sub-image display area in advance.

Incidentally, marks indicating the positions of reproducing points, editcandidate points, and edit points displayed on the time line 201T may bechanged in color by making the marks indicating reproducing pointsgreen, the marks indicating edit candidate points blue, and the marksindicating edit points red, for example, changed in shape by making themarks indicating reproducing points triangular marks, the marksindicating edit candidate points square marks, and the marks indicatingedit points circular marks, for example, or shifted from each other indisplay position, whereby the positions of the marks can be clearlyindicated to the user.

[Second Modification of Second Example]

In the foregoing recording and reproducing apparatus 600 in the secondexample, when a plurality of reproducing points are specified, speeds ofreproduction of moving images from the reproducing points are all equalto each other. However, the reproduction speed may be changed for eachreproducing point.

FIGS. 24 to 26 are diagrams of assistance in explaining an example wherea plurality of reproducing points are set and in simultaneousreproduction from each of the plurality of reproducing points, thereproduction speed is changed according to the position of thereproducing point.

FIG. 24 shows a case where three reproducing points MK1, MK2, and MK3are selected, and in simultaneous reproduction of moving images from thethree reproducing points, the moving image reproduced from thereproducing point MK1 is performed at a double speed (described as “×2”in the figure) and the moving image reproduced from the reproducingpoints MK2 and MK3 is performed at a single speed (described as “×1” inthe figure).

In the example of FIG. 24, single-speed reproduction is performed in amiddle stage part and a late stage part of the title, whereasdouble-speed reproduction is performed in an early stage of the title.Therefore, in the middle stage part and the late stage part of thetitle, an image of a target scene can be found at the normalreproduction speed, whereas in the early stage of the title, thedouble-speed reproduction is performed and hence an image of a targetscene can be detected more quickly.

When the reproduction speed is thus changed according to the pluralityof selected reproducing points, high-speed reproduction is performed ina part where a target scene is less likely to occur, and single-speed orlow-speed reproduction is performed in a part where a target scene ismore likely to occur, for example. Thus, the reproduction speed can beset for each selected reproducing point according to the purpose of theuser.

The reproduction speed for each reproducing point can be set via theremote control 150. The CPU 40 can change the moving image reproductionspeed for each reproducing point by changing the speed of reading datafrom the recording medium 18 or adjusting the processing speed of theMPEG video decoder 23 and the display image forming circuit 50 for eachselected reproducing point.

Also in the second modification, as in the second example of the secondembodiment, when a plurality of edit candidate points are set, one editcandidate point is selected from the plurality of edit candidate points.An image (still image) at a position corresponding to the edit candidatepoint and images (still images) adjacent to the position correspondingto the edit candidate point are displayed in a scrollable mode to allowsetting of a final edit point to be used at the time of editing.

In this case, for edit candidate points in sections of differentreproduction speeds, the number of still images displayed is made todiffer. FIG. 25 and FIG. 26 are diagrams of assistance in explainingprocessing when receiving a selection of an edit point with reference toedit candidate points in sections with different reproduction speeds.

One edit candidate point can be selected from a plurality of editcandidate points by moving a cursor CST to a unit of an edit candidatepoint on the time line 201T by operating the left arrow key or the rightarrow key on the remote control 150, and pressing the enter key 154, asshown in FIG. 25, for example.

When the selected edit candidate point is present in a section wheresingle-speed reproduction is performed, as shown in FIG. 25, an image ofthe selected edit candidate point (edit candidate point CN(1) in thecase of FIG. 25) and images of one frame preceding the image of theselected edit candidate point and one frame succeeding the image of theselected edit candidate point are displayed as thumbnails in the mainimage display area 201M to select an edit point.

Similarly, when the selected edit candidate point is present in asection where double-speed reproduction is performed, as shown in FIG.26, an image of the selected edit candidate point (edit candidate pointCN(2) in the case of FIG. 26) and images of two frames preceding theimage of the selected edit candidate point and two frames succeeding theimage of the selected edit candidate point are displayed as thumbnailsin the main image display area 201M to select an edit point. Thus, morethumbnails for edit point selection are displayed in a section of higherreproduction speed than in a section of lower reproduction speed.

The number of so-called thumbnail images for edit point selection isthus changed according to the reproduction speed because when the usermarks an edit candidate point on a screen of high reproduction speed,the edit candidate point is very likely to be distant from the desirededit point. That is, the higher the reproduction speed, the higher theprobability that the distance between the actually marked edit candidatepoint and the desired edit point is increased. Therefore, the number ofdisplayed still images adjacent to an edit candidate point is increasedin proportion to the reproduction speed. It is thus possible to selectan edit point more quickly.

When, at the time of recording information for identifying an image ofan edit candidate point on the recording medium 18 in response to aninstruction from the user, information is recorded indicating thereproduction speed of a section to which the edit candidate pointbelongs the information indicating the reproduction speed can be used toset the number of still images for edit point selection according to thereproduction speed by control of the CPU 40.

Incidentally, in FIG. 25 and FIG. 26, CN(n)+1 denotes an image one frameafter an edit candidate point CN(n), and CN(n)−1 denotes an image oneframe before the edit candidate point CN(n). Similarly, in FIG. 26,CN(n)+2 denotes an image two frames after the edit candidate pointCN(n), and CN(n)−2 denotes an image two frames before the edit candidatepoint CN(n).

[Third Modification of Second Example]

When the reproduction speed can be set for each reproducing point asdescribed above, a reproducing point ahead may be overtaken by apreceding reproducing point. In this case, the correspondence betweenthe reproducing points and sub-image display areas are changed on thescreen, so that it may be difficult to see information displayed on thescreen.

FIGS. 27A to 29C are diagrams of assistance in explaining a case of areproducing point ahead being overtaken by a preceding reproducing pointand the like. As shown in FIG. 27A, suppose that three reproducingpoints MK1, MK2, and MK3 are selected, that double-speed reproduction isperformed for the reproducing point MK1, and that single-speedreproduction is performed for the reproducing points MK2 and MK3.

When some time passes after reproduction is started in the state shownin FIG. 27A, the reproducing point MK2 is overtaken by the reproducingpoint MK1, as shown in FIG. 27B. In this case, the CPU 40 of therecording and reproducing apparatus 600 changes the moving imagesdisplayed in the sub-image display areas SG1, SG2, and SG3 according tothe positions of the reproducing points MK1, MK2, and MK3 on the timeline 201T.

In the example shown in FIGS. 27A and 27B, at a point in time when thereproducing point MK1 has overtaken the reproducing point MK2, the CPU40 changes (switches) display areas so as to display the image of thereproducing point MK2 in the sub-image display area SG1, and the imageof the reproducing point MK1 in the sub-image display area SG2, as shownin FIG. 27B.

Thereby, the sequence in which the reproducing points MK1, MK2, and MK3are arranged on the time line 201T coincides with the sequence in whichthe sub-image display areas SG1, SG2, and SG3 are arranged, thuseliminating confusing relations between the reproducing points and thesub-image display areas, and therefore preventing difficulty in seeingdisplayed information, a mistake in handling and the like.

Incidentally, the case of a preceding reproducing point overtaking areproducing point ahead is not limited to cases of differentreproduction speeds. For example, as shown in FIG. 28A, suppose thatwhen single-speed reproduction is performed for each of the selectedreproducing points MK1, MK2, and MK3 (described as “×1” in the figure),the reproducing point MK2 catches up with an edit candidate pointregistered during the reproduction from the reproducing point MK3 andthe reproducing point MK2 stops to determine an edit point, as describedabove.

In such a state, the reproducing points MK1 and MK3 do not stop, andtherefore the reproducing point MK1 overtakes the reproducing point MK2while the reproducing point MK2 is stopped. Also in such a case, at thepoint in time when the reproducing point MK1 has overtaken thereproducing point MK2, the CPU 40 changes display areas so as to displaythe image of the reproducing point MK2 in the sub-image display areaSG1, and the image of the reproducing point MK1 in the sub-image displayarea SG2, as shown in FIG. 28A.

Thereby, the sequence in which the reproducing points MK1, MK2, and MK3are arranged on the time line 201T coincides with the sequence in whichthe sub-image display areas SG1, SG2, and SG3 are arranged, thuseliminating confusing relations between the reproducing points and thesub-image display areas, and therefore preventing difficulty in seeingdisplayed information, a mistake in handling and the like.

As shown in FIG. 28B, after the reproducing point MK1 catches up withthe reproducing point MK2, the reproducing points MK1 and MK2 reproducethe same moving image, and therefore the reproducing points MK1 and MK2are integrated into one reproducing point, and the sub-image displayareas are also integrated into two sub-image display areas, that is, asub-image display area SGF and a sub-image display area SGE.

The image of the reproducing point resulting from the integration of thereproducing points MK1 and MK2 is displayed in the sub-image displayarea SGF, and the image of the reproducing point MK3 is displayed in thesub-image display area SGE. It is thereby possible to prevent display ofthe same moving image in a plurality of sub-image display areas and thusprevent difficulty in detecting an image of a target scene and the like.

[Fourth Modification of Second Example]

As in the processing when a reproducing point ahead is overtaken by apreceding reproducing point as described above in the third modificationof the second example, processing when a reproducing point aheadcompletes reproduction to an end of the title is also a problem. In thiscase, three methods are considered.

FIGS. 29A to 29C are diagrams of assistance in explaining the processingwhen a reproducing point ahead completes reproduction to an end of thetitle. First, FIG. 29A shows a case where, when a reproducing point MK3reproducing from a late stage part of the title completes reproductionto an end of the title, the reproducing point MK3 becomes a reproducingpoint from the beginning of the title to continue reproduction, and theimages displayed in the sub-image display areas SG1, SG2, and SG3 arecorrespondingly interchanged with each other.

Further, FIG. 29B shows a case where, when a reproducing point MK3reproducing from a late stage part of the title completes reproductionto an end of the title, the movement of the reproducing point MK3 isstopped at the end of the title, and that state is maintained. Hence, inthe case of FIG. 29B, when both reproducing points MK1 and MK2 completereproduction to the end of the title, the same image is displayed in thesub-image display areas SG1, SG2, and SG3.

Further, FIG. 29C shows a case where, when a reproducing point MK3reproducing from a late stage part of the title completes reproductionto an end of the title, the reproducing point MK3 and the sub-imagedisplay area SG3 displaying a reproduced image at a positioncorresponding to the reproducing point MK3 are erased, and onlyreproducing points MK1 and MK2 yet to complete reproduction to the endand the sub-image display areas SG1 and SG2 displaying imagescorresponding to the reproducing points MK1 and MK2 are left.

By using any one of the methods of FIGS. 29A to 29C, it is possible toprevent difficulty in seeing or understanding information displayed onthe screen or the like, and thus relatively easily find an image of atarget scene.

THIRD EXAMPLE

Instead of the user setting the number and position of reproducingpoints as in the foregoing second example, a recording and reproducingapparatus in the third example effects automatic control to change thenumber and position of reproducing points according to imagereproduction speed, thereby making it possible to quickly and accuratelydetect a target image of a target scene from a series of titles.Incidentally, the recording and reproducing apparatus in the thirdexample is the same as the recording and reproducing apparatus 600 shownin FIG. 13.

The recording and reproducing apparatus 600 in the third example allowsfree setting of speed of title reproduction at the time of titlereproduction. The reproduction speed can be set via the remote control150. At the time of reproduction, a reproduced image is displayed on theentire surface of the display screen 201, as shown in FIG. 30. At thesame time, a sub-image display area SG1 is provided in a lower portionof the display screen 201 to display a read image ahead.

In this case, a reproducing point in the title of the image displayed onthe entire surface of the display screen 201 is indicated by a currentreproduction position mark NL on a time line 201T, and a reproducingpoint in the title of the image displayed in the sub-image display areaSG1 is indicated by a read-ahead point PT1 on the time line 201T.

In the example of FIG. 30, as indicated by a reproduction speed 201C,reproduction is performed at a double speed (described as “×2” in FIG.30). The state shown in FIG. 30 is the same as the state shown in FIG.31A. When the reproduction speed is the double speed or so, for example,inconveniences of missing an image of a target scene and the likebecause the speed is too high are less likely to occur.

However, when reproduction is performed at a relatively high speed, forexample 5× speed, the possibility of missing an image of a target sceneis increased. Accordingly, as shown in FIG. 31B, when the 5× speedreproduction is performed, for example, two sub-image display areas SG1and SG2 are provided, and images reproduced from positions correspondingto read-ahead points PT1 and PT2 separated at a predetermined intervalare displayed in the sub-image display areas SG1 and SG2.

As shown in FIG. 31C, when 10× speed reproduction is performed, forexample, three sub-image display areas SG1, SG2 and SG3 are provided,and images reproduced from positions corresponding to read-ahead pointsPT1, PT2, and PT3 separated at predetermined intervals are displayed inthe sub-image display areas.

Thus, by increasing the number of sub-image display areas for displayingimages read ahead as the reproduction speed becomes higher, it ispossible to check the images read ahead from a plurality of differentreproducing points via the plurality of sub-image display areas when thereproduction speed is high, and thus detect a target image of a targetscene without missing the target image.

Incidentally, in the third example, the image displayed on the entiresurface of the display screen 201 is formed by themultiplexing/separating circuit 16, the MPEG video decoder 23, and thevideo signal post-processing circuit 24. The images displayed in thesub-image display areas SG1, SG2, SG3, . . . are formed by themultiplexing/separating circuit 16, the MPEG video decoder 23, and thedisplay image forming circuit 50.

Then, the image from the video signal post-processing circuit 24 and theimage from the display image forming circuit 50 displayed in one or moresub-image display areas are combined with each other by the combiningcircuit 26, and the result is output via the NTSC encoder 27.

As described above, the images based on image data from the plurality ofreproducing points including the current reproduction position arereproduced simultaneously. The image data sequentially read from thedifferent reproducing points of the recording medium 18 by the buffercontrol circuit 17 controlled by the CPU 40 is combined and processed ascontinuous image data from the reproducing points.

When an image of a target scene is displayed in a sub-image displayarea, a cursor CST movable so as to correspond to each of thereproducing points PT1, PT2, PT3, . . . on the time line 201T ispositioned at the target reproducing point, as shown in FIG. 32.Thereby, frame images for setting an edit point are displayed on thedisplay screen with reference to the image of the reproducing point atwhich the cursor CST is positioned (the image of the reproducing pointPT2 in the example of FIG. 32).

In the example of FIG. 32, a total of five frame images including twoframes preceding the image of the reproducing point PT2 at which thecursor CST is positioned and two frames succeeding the image of thereproducing point PT2, that is, five frame images PT2−2, PT2−1, PT2,PT2+1, and PT2+2, are displayed in a scrollable mode. Then, a cursor CSmovable on the five displayed frame images is moved to thereby select afinal edit point and register the final edit point on the recordingmedium 18.

It is to be noted that while in the description above with reference toFIG. 31, one sub-image display area is used when the reproduction speedis double speed, two sub-image display areas are used when thereproduction speed is 5× speed, and three sub-image display areas areused when the reproduction speed is 10× speed, the present invention isnot limited to this.

For example, the number of sub-image display areas to be used accordingto the reproduction speed may be set arbitrarily, and the intervalsbetween the reproducing points may be set arbitrarily. Further, when twoor more sub-image display areas are used, the intervals between thereproducing points including the current reproduction position may bemade different from each other by, for example, making the intervalbetween the current reproduction position and the first reproducingpoint different from the interval between the first reproducing pointand the second reproducing point. Of course, the intervals between thereproducing points including the current reproduction position can allbe made equal to each other.

FOURTH EXAMPLE

The fourth example reuses edit points registered in the past to therebyenable quick detection and registration of edit points of a title to beedited this time.

In the case of television broadcast programs of a serial drama, forexample, though contents of each broadcast program are changed, acommercial is inserted at substantially the same time in many cases. Inanother case, a segment broadcast at a fixed time in a program broadcastevery week may be unnecessary.

In a case where a scene to be subjected to editing, such as movement,deletion and the like, is thus broadcast at a substantially fixed timein a target program, when the recording and reproducing apparatusaccording to the second embodiment records the program on the recordingmedium 18 and registers edit points for editing, the informationindicating the edit points can be reused because the informationindicating the edit points is registered on the recording medium 18.

Specifically, in edit point information recorded on the recording medium18, a title and one or more edit points are stored in association witheach other. A main information signal referred to as a title of abroadcast program or the like recorded on the recording medium 18 isprovided with title identifying information.

Hence, when reproducing a title recorded on the recording medium, theCPU 40 determines whether there is edit point information having thesame title identifying information, and when there is edit pointinformation having the same title identifying information, the CPU 40uses the edit point information to form information indicating editcandidate points, and displays the information indicating edit candidatepoints in combination with a reproduced image.

FIG. 33 and FIG. 34 are diagrams of assistance in explaining an image inwhich edit candidate point information is displayed by using past editpoint information in the fourth example. As shown in FIG. 33, areproduced image of a title being reproduced is displayed on the entiresurface of the display screen 201.

In this case, when edit point information having the same titleidentifying information as that of the title being reproduced is alreadypresent on the recording medium 18, edit candidate points PP1, PP2, andPP3 are displayed on a time line 201T on the basis of the edit pointinformation, and moving images corresponding to the positions indicatedby the edit candidate points are displayed in sub-image display areasSG1, SG2, and SG3.

However, even in the case of a serial program broadcast at a fixed timeevery week, for example, it is difficult to assume that an edit pointfor a program broadcast last time is exactly the same as an edit pointfor a program broadcast this time. Even with the same program, an errorof a few seconds can occur.

Accordingly, as in the foregoing first to third examples, frame imagesadjacent to an edit candidate point are displayed in a scrollable mode,and an edit point is determined from among the displayed frame images.FIG. 34 shows a state in which frame images adjacent to an editcandidate point are displayed.

Specifically, in FIG. 34, a cursor CST is positioned at the first editcandidate point PP1 of the three edit candidate points PP1, PP2, and PP3being displayed. Frame images of two preceding frames and two succeedingframes with reference to the image of the edit candidate point PP1 aredisplayed in a scrollable mode as images for edit point selection.

In this state, a cursor CS is positioned to a target frame image, adetermining operation such as pressing the enter key or the like isperformed to thereby determine the edit point, and the determined imageposition as the edit point is registered in edit point information onthe recording medium.

Incidentally, when the left arrow key on the remote control 150 ispressed to position the cursor CS to the leftmost frame image of thefive frame images displayed in the frame image display area 201S andthereafter the left arrow key is further pressed, the frame images arescrolled by one frame in the right direction.

When the right arrow key on the remote control 150 is pressed toposition the cursor CS to the rightmost frame image of the five frameimages displayed in the frame image display area 201S and thereafter theright arrow key is further pressed, the frame images are scrolled by oneframe in the left direction.

Incidentally, also in the fourth example, the image displayed on theentire surface of the display screen 201 is formed by themultiplexing/separating circuit 16, the MPEG video decoder 23, and thevideo signal post-processing circuit 24. The images displayed in thesub-image display areas SG1, SG2, SG3, . . . and the frame imagesdisplayed in the frame image display area 201S are formed by themultiplexing/separating circuit 16, the MPEG video decoder 23, and thedisplay image forming circuit 50.

Then, the image from the video signal post-processing circuit 23 and theimages from the display image forming circuit 50 are combined with eachother by the combining circuit 26, and the result is output via the NTSCencoder 27.

As described above, images based on image data from a plurality ofreproducing points are reproduced simultaneously. The image datasequentially read from the different reproducing points of the recordingmedium 18 by the buffer control circuit 17 controlled by the CPU 40 iscombined and processed as continuous image data from the reproducingpoints.

By thus enabling use of the edit point information registered in thepast, it is possible to quickly and accurately set and register an editpoint for a broadcast program of a serial drama or the like recordedregularly.

Incidentally, in the description above of the fourth embodiment, acorrespondence between the edit point information already registered anda title newly recorded is established by using title identifyinginformation for identifying each title. The title identifyinginformation in this case includes, for example, not only a title name, atitle number or the like input by the user or the like, but alsoinformation comprising a recording date and time, a day of the week, abroadcasting channel and the like.

Edit candidate points and edit points may be managed throughout usingpositional information or temporal information with respect to movingimages as a whole, such as time codes (time stamps), frame numbers orthe like as described above, recording time information, or positionalinformation with respect to the recording medium as a whole.

It is to be noted that while in the embodiments described above,information on chapter marks, information on edit candidate points, andinformation on edit points are recorded in a separate file provided onthe recording medium 18, the present invention is not limited to this.The information on chapter marks, the information on edit candidatepoints, and the information on edit points may be recorded in a memoryof the recording and reproducing apparatus 100.

In this case, when the recording medium 18 is removable, information foridentifying the recording medium, information for identifying a title,and information on chapter marks, information on edit candidate pointsor information on edit points are recorded in association with eachother. It is thereby possible to prevent mismatching even when therecording medium 18 is removed and replaced with another recordingmedium.

Also, the recording medium 18 of the recording and reproducing apparatus100 is not limited to a hard disk; various recording media such asoptical disks, magneto-optical disks, semiconductor memories and thelike can be used as the recording medium 18. Further, the recordingmedium 18 is not limited to being disposed within the recording andreproducing apparatus 100; image information recorded on a hard diskdevice connected externally or the like can be used as information forreproduction.

Further, while the foregoing embodiments have been described by takingas an example a case where the present invention is applied to arecording and reproducing apparatus using a hard disk as a recordingmedium, the present invention is not limited to this. The presentinvention is also applicable to video camera devices. That is, thepresent invention is applicable to various recording and reproducingapparatus that can capture image information, record the imageinformation on a recording medium, and have a function of reproducingthe recorded image information.

The present invention is also applicable to reproducing apparatus havinga function of reproducing image information recorded on a recordingmedium. In this case, even when the reproducing apparatus cannot writeinformation on chapter marks or information on edit points to therecording medium, it suffices to be able to write the information onchapter marks and the information on edit points to a memory of thereproducing apparatus and read the information on chapter marks and theinformation on edit points as required.

Further, the number of sub-image display areas and the number of stillimages (thumbnails) displayed for edit point selection are not limitedto those of the foregoing embodiments; the number of sub-image displayareas and the number of still images (thumbnails) displayed for editpoint selection may be increased or decreased according to the size ofthe display screen or the like.

As described above, according to the present invention, it is possibleto perform editing as required basically in the reproduction mode,without the need for properly using two different modes, that is, thereproduction mode and the edit mode, as with conventional recording andreproducing apparatus. Therefore, inconveniences of not knowing anoperation for shifting to the edit mode, taking time to shift to theedit mode, or the like are obviated.

In addition, editing operations are very easy because editing operationscan be performed by using a very limited number of operating keys of anoperating device, such as a remote control or the like. Therefore,inconveniences of

1. An image detecting apparatus, comprising: extracting means forextracting one or more frame images from a plurality of frame imagesforming a moving image; display controlling means for controlling thedisplay of a group of frame images consisting of said extracted frameimage and a predetermined number of frame images temporally precedingand succeeding said extracted frame image; and specifying means forselecting and specifying a desired frame image from among said group offrame images.
 2. An image detecting apparatus as claimed in claim 1,wherein a number of frame images in said group of frame images isproportional to a display speed of said moving image.
 3. An imagedetecting apparatus as claimed in claim 1, whereinsaid extracting meansextracts said one or more frame images on the basis of a predeterminedpattern.
 4. An image detecting apparatus as claimed in claim 3,whereinsaid pattern corresponds to positional information of a frameimage specified previously by said specifying means.
 5. An imagedetecting apparatus, comprising: first extracting means for extracting apredetermined number of frame images from among a plurality of frameimages forming a moving image; first display controlling means forcontrolling the display of a predetermined number of moving images andsaid predetermined number of frame images as initial images; firstspecifying means for selecting and specifying a desired moving imagefrom among said predetermined number of moving images; second extractingmeans for extracting an arbitrary frame image from said desired movingimage; second display controlling means for controlling the display of agroup of frame images consisting of said arbitrary frame image and apredetermined number of frame images temporally preceding and succeedingsaid arbitrary frame image; and second specifying means for selectingand specifying a desired frame image from among said group of frameimages.
 6. An image detecting apparatus claimed in claim 5, wherein saidpredetermined number of frame images is proportional to a display speedof said predetermined number of moving images.
 7. An image detectingapparatus as claimed in claim 5, whereinsaid first display controllingmeans effects control such that at least one of said predeterminednumber of moving images is displayed at a different display speed than aremainder of said predetermined number of moving images.
 8. An imagedetecting apparatus as claimed in claim 5, wherein said second displaycontrolling means controls the display of said group of frame imageswhena position of said arbitrary frame image coincides with a position of aframe image forming at least one moving image of said predeterminednumber of moving images.
 9. An image detecting apparatus as claimed inclaim 5, whereinsaid first extracting means extracts said predeterminednumber of frame images on the basis of a predetermined pattern.
 10. Animage detecting apparatus as claimed in claim 9, whereinsaid patterncorresponds to positional information of a frame image specifiedpreviously by said second specifying means.
 11. An image detectingmethod, comprising: extracting one or more frame images from a pluralityof frame images forming a moving image; controlling the display of agroup of frame images consisting of the extracted frame image and apredetermined number of frame images temporally preceding and succeedingthe extracted frame image; and selecting and specifying a desired frameimage from among the group of frame images.
 12. An image detectingmethod as claimed in claim 11, wherein a number of frame images in thegroup of frame images is proportional to a display speed of the movingimage.
 13. An image detecting method as claimed in claim 11, whereinsaidextracting step includes extracting the one or more frame images on thebasis of a predetermined pattern.
 14. An image detecting method asclaimed in claim 13, whereinthe pattern corresponds to positionalinformation of a frame image specified previously in said selecting andspecifying step.
 15. An image detecting method, comprising: extracting apredetermined number of frame images from among a plurality of frameimages forming a moving image; controlling the display of apredetermined number of moving images and the predetermined number offrame images as initial images; selecting and specifying a desiredmoving image from among the predetermined number of moving images;extracting an arbitrary frame image from the desired moving image;controlling the display of a group of frame images consisting of thearbitrary frame image and a predetermined number of frame imagestemporally preceding and succeeding the arbitrary frame image; andselecting and specifying a desired frame image from among the groupofframe images.
 16. An image detecting method as claimed in claim 15,wherein the predetermined number of frame images is proportional to adisplay speed of the predetermined number of moving images.
 17. An imagedetecting method as claimed in claim 15, wherein the display of thepredetermined number of moving images is controlledsuch that at leastone of the predetermined number of moving images is displayed at adifferent display speed than a remainder of the predetermined number ofmoving images.
 18. An image detecting method as claimed in claim 15,wherein the group of frame images is displayed when a position of thearbitrary frame image coincides with a position of a frame image formingat least one moving image of the predetermined number of moving images.19. An image detecting method as claimed in claim 15, whereinsaid stepof extracting the predetermined number of frame images includesextracting the predetermined number of frame images on the basis of apredetermined pattern.
 20. An image detecting method as claimed in claim19, wherein the pattern corresponds to positional information of a frameimage specified previously in said step of specifying and selecting saiddesired frame image.
 21. A recording medium recorded with an imagedetecting program executable by a computer, said image detecting programcomprising: extracting one or more frame images from a plurality offrame images forming a moving image; controlling the display of a groupof frame images consisting of the extracted frame image and apredetermined number of frame images temporally preceding and succeedingthe extracted frame image; and receiving a selection and specificationof a desired frame image from among the group of frame images.
 22. Arecording medium as claimed in claim 21, wherein a number of frameimages in the group of frame images is proportional to a display speedof the moving image.
 23. A recording medium as claimed in claim 21,wherein said extracting step includes extracting the one or more frameimages on the basis of a predetermined pattern.
 24. A recording mediumas claimed in claim 23, whereinthe pattern corresponds to positionalinformation of a frame image specified previously in said receivingstep.
 25. A recording medium recorded with an image detecting programexecutable by a computer, said image detecting program comprising:extracting a predetermined number of frame images from among a pluralityof frame images forming a moving image; controlling the display of apredetermined number of moving images and the predetermined number offrame images as initial images; receiving a selection and specificationof a desired moving image from among the predetermined number of movingimages; extracting an arbitrary frame image from the desired movingimage; controlling the display of a group of frame images consisting ofthe arbitrary frame image and a predetermined number of frame imagestemporally preceding and succeeding the arbitrary frame image; andreceiving a selection and specification of a desired frame image fromamong the group of frame images.
 26. A recording medium as claimed inclaim 25, wherein the predetermined number of frame images isproportional to a display speed of the predetermined number of movingimages.
 27. A recording medium as claimed in claim 25, wherein thedisplay of the predetermined number of moving images is controlled suchthat at least one of the predetermined number of moving images isdisplayed at a different display speed than a remainder of thepredetermined number of moving images.
 28. A recording medium as claimedin claim 25, wherein the group of frame image is displayed when aposition of the arbitrary frame image coincides with a position of aframe image forming at least one moving image of the predeterminednumber of moving images.
 29. A recording medium as claimed in claim 25,whereinsaid step of extracting the predetermined number of frame imagesincludes extracting the predetermined number of frame images on thebasis of a predetermined pattern.
 30. A recording medium as claimed inclaim 29, wherein thepattern corresponds to positional information of aframe image specified previously in said step of receiving the selectionand specification of the desired frame image.